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EFFECTS  OF  VISUAL  SYSTEM  TRANSPORT  DELAY  ON  PILOT  PERFORMANCE 

Grant  R.  McMillan 
Armstrong  Laboratory,  AL/CFHO 
Wright-Patterson  Air  Force  Base,  OH  45433-6573 
(513)  255-8746 


Transport  delay  has  been  a  concern  in  many  man-machine  svet-emo  T*- 
been  especially  nroblematir  * .  *  macnine  systems.  It  has 

h°"  “Ch  tran,p°rt  ^  “  other itemporal 

that  there  was  a  significant  amount  of  data  concerning  transport  delay  and  the 
performance  of  laboratory  tracking  tasks.  However,  few  data  were  available  on 
the  effects  of  delay  on  transfer  of  training,  the  effects  of  delay  Is  a 

function  of  aircraft  type,  and  the  effects  of  delay  on  realistic  flight  tasks 

rIlIIive°Lr  Y  d\ffering  methodolo9ies'  it  was  difficult  to  determine  the 
If  trilling  y  S6nSitlVlty  °f  pilot  ratings,  pilot  performance,  and  transfer 

Therefore,  the  Human  Engineering  Division  of  the  Armstrong  Laboratory 
began  a  multi-year  investigation  of  the  problem  with  the  sponsorship  of  the 
Aeronautical  Systems  Division,  Training  Systems  Program  Office.  This 
research  program  will  be  completed  with  the  publication  of  a  guide  entitled 
Time  Del?y  and  Synchrony  in  Flight  Simulators  in  1992.  This  paper  briefly 
summarizes  the  findings  of  this  research  program  as  well  as  the  results  of 
other  work  addressing  the  simulator  temporal  fidelity  issue. 


Background 

Before  beginning  the  discussion  of  the  research  findings,  it  is  useful  to 
define  a  few  terms.  Transport  del«y,  or  pure  time  delay,  is  simply  dead  time 
a  system*  Transport  delay  does  not  change  the  shape  of  a  waveform.  It 
simply  shifts  it  in  time,  regardless  of  the  frequency  content.  If  the  system 
includes  dynamic  elements  (e.g.  filters),  these  elements  will  produce  phase 

r;?-°r  H  the  input  is  a  periodic  waveform.  Because  their ‘ filtering 

action  depends  on  the  frequency  of  the  input,  such  elements  will  typically 
change  the  shape  of  a  complex  waveform. 

There  are  numerous  sources  of  these  temporal  distortions  in  flight 
simulators.  One  source  is  the  digital  computations  involved  in  the  simulator 
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aerodynamic  model.  A  more  important  source  is  the  image  generation  svstem 
ST  of  ^^ent  flight  simulators.  Once  the  image  generator  has  received 
the  current  aircraft  state  information  from  the  aerodynamic  model,  the 

fiSPl^y  Can"°t  **  9enerated  instantaneously.  Some  finite  time  period 
required.  Typically  this  is  one  or  more  time  frames  of  the  image 

processor,  and  the  resulting  delay  will  be  in  the  range  of  S0-100  milliseconds 
(ms ) . 


Other  elements  of  the  flight  simulator  that  produce  phase  lags  or  pure 
time  delays  include  physical  data  holds  in  the  digital  to  analog  conversion 
(DAC)  process,  low  pass  filters  to  smooth  DAC  outputs,  data  holds  between 
subsystems  operating  at  different  iteration  rates,  and  any  delays  or  dynamics 
associated  with  the  actual  display  devices  (CRT  frame  rates,  motion  base 
dynamics,  etc.). 


Effects  of  Delay  on  Pilot  Ratings  and  Performance  in  the  Simulator 


Axis  of  Aircraft  Control 

Three  research  studies  have  investigated  the  effects  of  time  delay  on 
various  axes  of  flight  control.  Cooper,  Harris,  and  Sharkey  (1975)  measured 
the  performance  of  pilots  flying  simulated  carrier  approaches  with  and  without 
an  additional  100  ms  delay  inserted  in  the  C1G  display  loop.  The  authors  do 
not  give  the  baseline  delay  value.  The  only  effects  observed  on  pilot 
behavior  were  in  lateral-axis  control.  Ricard,  Norman,  and  Collyer  (1976) 
assessed  the  performance  of  simulated  straight-and-level  flight  in  the 
presence  of  mild  turbulence.  An  artificial  horizon  display  was  provided  and 
delays  of  17.5  to  1400  ms  were  investigated.  While  control  of  pitch  angle  was 
hardly  affected  by  the  delays,  roll  errors  tended  to  increase  when  the  delay 
exceeded  100  ms.  In  more  recent  work  at  the  Armstrong  Laboratory,  Riccio, 
Cress  and  Johnson  (1987)  found  that  lateral-axis  control  was  more  sensitive  to 
added  delay  than  altitude  control.  In  this  experiment,  subjects  were 
attempting  to  maintain  a  specified  heading  and  altitude  in  the  presence  of 
strong  turbulence  (Figure  1). 


Aircraft  Dynamics 

Queijo  and  Riley  (1975)  investigated  pure  time  delays  of  47-297  ms  using 
the  NASA  Visual  Motion  Simulator  (VMS).  The  simulator  was  used  in  a  fixed- 
base  mode,  and  pilots  tracked  a  vertically  oscillating  target  driven  by  a  0.03 
Hz  sinusoid.  This  represented  a  relatively  easy  tracking  task.  Seventeen 
configurations  of  aircraft  dynamics  were  investigated,  covering  a  range  of 
excellent  to  poor  handling  qualities.  All  configurations  included  a  baseline 
transport  delay  of  47  ms.  Delays  of  0-250  ms  were  added  to  this  baseline. 

The  authors  found  that  tolerable  delay  is  not  a  monotonic  function  of  aircraft 
responsiveness  (Figure  2).  That  is,  both  sluggish  and  highly  responsive 
aircraft  appeared  to  be  less  tolerant  of  delays.  Unfortunately,  the  analyses 
did  not  permit  one  to  determine  if  the  differences  were  statistically 
significant.  ‘ 
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FIGURE  1. 


EFFECTS  OF  TIME  DELAY  ON  HEADING  AND  ALTITUDE  CONTROL 

"IT"  SIWLMro  hobte*  and  transpoS 

•  (From  Riceio,  Cress  and  Johnson,  1987) 


than  Sjo  "°re  de,"“di"9  «w»t  t..*. 

above  results. 

slmulatid^iohte^^d'r  e£feCte  °f  ti”e  a«1*F»  on  performance  with 
haB  Jated  fighter  and  transport  dynamics.  Both  simulated  aircraft  included 

h“:i“:  ThePflLht1ryev°f  50.”'-  D*1*y*  °f  °-350  -  ""  •*£  to  th tv 

^  i  9  required  the  subjects  to  maintain  a  constant 

heading  and  100  ft.  altitude  over  flat  terrain.  Wide-bandwidth  turbulence 

continually  perturbed  the  aircraft's  flight  path.  This  task,  although 

error  rS  demandin9*  The  percent  change  in  root-mean-square 

or  With  time  delay  is  shown  in  Figure  1.  Although  the  delay  effects  were 
ewhat  larger  for  the  transport  aircraft,  the  differences  between  the 
fighter  and  transport  were  not  statistically  significant.  In  both  cases 
delay  significantly  degraded  heading  and  altitude  control. 

As  part  of  the  Armstrong  Laboratory  research  program,  Calspan  Coro 

both  nr* e*:t:e °i studies usin? the nrii.9  t^mS^ssit  in 

(Bailey  et^l”  1987)  are  in_fli?ht  modes*  The  data  from  some  of  this  work 
(  iiey  et  al.,  1987)  are  summarized  in  Figure  3.  Four  aircraft 

Dilfir,?  °nS  Were  hl9h  fldellty  simulations  of  the  actual  vehicle.  The 
pilots  flew  a  variety  of  demanding,  teak,  .elected  to  permit  ..nilt.  flyi„g 
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t  t  I 

C-141  C-17  C-21  F 

LONGITUDINAL  SHORT-PERIOD  RESPONSE 
(RAD/SEC) 


FIGURE  2.  TOTAL  TRANSPORT  DELAY  REQUIRED  TO  PRODUCE  A  TEN 

PERCENT  INCREASE  IN  TRACKING  ERROR  AS  A  FUNCTION  OF 
SIMULATED  AIRCRAFT  LONGITUDINAL  DYNAMICS.  The 
responsiveness  of  several  aircraft  are  noted  below. 
The  solid  line  represents  results  averaged  over 
several  damping  ratios,  where  appropriate.  The 
open  circles  represent  individual  data  points  for 
the  damping  ratios  shown.  (From  Ricard  and  Puig, 
1977,  who  replotted  Queijo  and  Riley's  data) 


evaluations .  All  tasks  were  presented  on  a  head-up— display  (HUD) 
and  the  pilots  wore  a  special  visor  that  prevented  them  from  seeing  outside 
the  cockpit.  The  ground-based  evaluation  utilized  the  actual  NT— 33 
connected  to  a  computer  system.  The  primary  difference  between  the  in¬ 
flight  and  ground-based  cases  was  the  presence  or  absence  of  aircraft 
motion.  Each  of  the  four  simulated  aircraft  included  a  baseline  delay  of 
100  ms  over  and  above  the  aircraft  phase  lag.  The  delays  shown  in  the 
figure  were  added  to  this  basic  delay. 
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COOPER -HARPER  PILOT  RATING 


The  in-flight  data  in  Fioure  3 

.  simulated  aircraft,  the  pilots  rated  the  base?*1*8*  t0  interPret-  For  all 
,  having  Level  1  handling  qualities.  Level  1  rating**?  (1°°  “  delay)  aa 
t  ratings  of  l,  2  or  3,  are  required  before  t  ^  ?  i***  CooP®r-H»rper 

mto  the  military  inventory.  For  all  aircraft  thT***^  C*n  ***  accepted 
:  the  pilot  ratings  cross  the  Level  1  to  Leve^  ? ' ^'L**9™**^™  fitted  to 
-  delay  (50-100  ms  added  delay).  The  J  at  ms  total 

selected,  the  four  aircraft  were  ^out  ^.  ,  f  ^  that'  f°r  the  taaka 

will  be  corroborated  in  the  next  section^tlw/i  8e“si^1’v®  to  time  delay.  As 
ground-based  cases  made  the  pilots  more  °f  motion  cuea  Ln  the 

the  baseline  delay  ^"a^  '  ~ 

variables  when  considering^he  ff  f  J^rorti^^!"9  qualities  are  important 
recent  studies  suggest  that  under  hioh  j?1*7’  Kev*rthel®»a*  the 

subjective  ratings  will  be  eouallv^df - ZZ  Pilot  performance  and 

aircraft.  This  concluL^  t4T  ^  for  a11  *»-  of 

results  shown  in  Figure  2.  in  that  fTm  y  oonsistent  with  the  earlier 

show  about  50  ms  difference  in  their  dS^y'sensiti^.0"17'  “**  C‘21  °nly 
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FIGURE  3. 


AO0E0  Time  DELAY  (immc) 

EFFECTS  OF  IN-FLIGHT  AND  GROUND-BASED  SIMULATOR  DELAYS 
ON  RATED  HANDLING  QUALITIES  FOR  FOUR  DIFFERENT 
SIMULATED  AIRCRAFT.  Delays  shown  were  added  to  the 
basic  system  delay  of  100  ms.  Dotted  lines  show  the 
point  at  which  handling  qualities  ratings  cross  from 
Level  1  to  Level  2  for  the  in-flight  case.  (From 
Bailey  et  al.,  1987) 
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Motion  Effects 


By  essentially  repeating  the  Queijo  and  Riley  study  with  the  VMS  motion 
base  active.  Miller  and  Riley  (1976)  demonstrated  that  providing  motion  cues 
can  significantly  reduce  the  effects  of  time  delays.  Both  the  visual  and 
motion  cues  were  delayed  equally.  For  their  "basic"  airplane,  which  had  a 
handling  qualities  rating  of  5,  the  acceptable  delay  in  a  fixed— base  mode 
was  172  ms.  Statistically  significant  degradations  in  performance  were 
observed  for  longer  delays.  When  the  motion  base  was  active,  the  acceptable 
delay  increased  to  297  ms.  Since  motion  cues  are  known  to  allow  a  pilot  to 
generate  additional  lead  compensation  (Shirachi  and  Shirley,  1977),  this 
result  is  quite  reasonable.  In  my  opinion,  the  absolute  values  of 
acceptable  delay  reported  in  the  two  VMS  studies  should  be  used  with  caution 
because  of  the  relative  ease  of  the  tracking  task,  the  small  number  of 
subjects,  and  the  variation  in  criteria  used  to  determine  acceptable  delays. 
However,  there  is  no  reason  to  believe  that  the  trends  observed  in  these  two 
studies  are  not  correct,  especially  given  the  results  of  the  Calspan  NT-33 
studies  reported  above. 


Task  Type 

One  reason  for  the  caveat  on  the  two  VMS  studies  is  that  task 
difficulty  has  been  shown  to  be  an  important  determinant  of  delay  effects. 

In  fact,  Queijo  and  Riley  (1975)  and  Miller  and  Riley  (1976)  also 
manipulated  the  difficulty  of  their  tracking  task.  When  the  target 
frequency  was  doubled,  the  acceptable  time  delay  decreased  by  a  factor  of 
two  to  three.  Sevier,  et  al.  (1984)  investigated  the  effects  of  110  vs.  160 
ms  visual  system  delays  on  the  performance  of  two  tasks:  (1)  tracking  a 
target  which  was  oscillating  vertically,  or  (2)  maintaining  a  constant  45 
degree  bank  angle  using  a  constant-rate  turning  target  as  a  reference. 

‘Effects  were  only  observed  for  the  more  difficult  pitch  tracking  task. 

In  our  research  program,  a  number  of  flight  control  tasks  have  been 
investigated.  In  the  most  recent  work,  delay  effects  on  a  sidestep  landing 
maneuver  (Whiteley  and  Lusk,  1990)  and  on  a  low-level  flight  task 
(Middendorf,  Fiorita,  and  McMillan,  1991)  were  evaluated.  In  both  studies 
the  baseline  fighter  aircraft  dynamics  included  a  transport  delay  of  90  ms, 
similar  to  the  Calspan  study  reported  above.  This  baseline  delay  is 
actually  representative  of  modern  fighter  aircraft  such  as  the  F-16.  Delays 
of  110  or  210  ms  were  added  to  this  baseline  case.  For  both  tasks,  total 
delays  of  300  ms  produced  statistically  significant  degradations  in 
performance  and  were  clearly  unacceptable.  Total  delays  of  200  ms  degraded 
some  aspects  of  performance  in  both  experiments,  and  probably  represent  the 
maximum  permissible  delay  for  these  tasks.  Figure  4  presents  some 
representative  data  from  the  low-level  flight  experiment. 
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Transport  Delay  (ms) 


FIGURE  4.  EFFECTS  OF  TRANSPORT  DELAY  ON  ALTITUDE  ERROR  IN  A 
SIMULATED  LOW-LEVEL  FLIGHT  TASK.  Subjects  were 
required  to  fly  at  an  altitude  of  175  feet  over 
rolling  terrain.  Bars  show  the  mean  plus  and  minus 
the  95%  confidence  intervals  from  a  Tukey’s 
multiple-comparison  test.  (From  Middendorf,  Fiorita, 
and  McMillan,  1991) 


Effects  of  pelav  on  Transfer  of  Training 

Because  so  few  data  were  available  in  the  literature,  several 
experiments  in  the  Armstrong  Laboratory  program  have  investigated  the 
effects  of  delay  on  transfer  of  training.  The  Riccio,  Cress,  and  Johnson 
study  (1987)  cited  above  is  one  example.  An  interesting  pattern  has  emerged 
from  this  work.  First,  delays  of  100  ms  or  less  seero  to  have  a  slight  (but 
nonsignificant)  positive  effect  on  transfer.  Perhaps  the  delay  compensation 
skills  learned  during  training  permit  the  subject  to  apply  even  higher 
bandwidth  control  when  the  delay  is  removed.  Second,  significant  transfer 
degradation  does  not  occur  unless  training  delays  axe  in  the  300-400  ms 
range.  These  and  other  data  strongly  suggest  that  delays  have  a  greater 
negative  effect  on  performance  than  on  the  transfer  of  training. 


Guidelines  for  Acceptable  Transport  Delay 

Despite  the  relatively  large  data  base  concerning  the  effects-  of 
transport  delay  errors  on  pilot  performance,  clear  standards  exist'  only  for 
commercial  aircraft  simulators.  At  least  two  problems  contribute  to  this 
situation.  First,  most  of  the  systematic  research  has  used  inconsistent 
criteria  to  determine  "acceptable  delays",  has  used  very  few  subjects,  and 
has  employed  idealized  tasks  which  are  difficult  to  generalize  to  a  complex 
full-mission  simulator.  Second,  the  state-of-the-art  in  computer  power 
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still  makes  it  difficult  to  achieve  even  the  tentative  standards  the 
research  suggests,  naturally,  we  are  reluctant  to  set  standards  that  cannot 
be  realized  at  an  acceptable  cost.  If  there  is  a  consensus  among  experts, 
it  appears  that  a  value  of  100  ms  is  most  likely  to  be  quoted  as  a  maximum 

Boarr^^S^R^  ^  perfor*ance  aircraft  (USAF  Scientific  Advisory 
Board,  1978;  Ricard  and  Puig,  1977).  Although  not  explicitly  stated,  one 

may  assume  that  this  delay  may  be  added  to  the  response  time  of  the 
simulated  aircraft. 


With  the  advent  of  digital  fly-by-wire  aircraft  and  complex  flight 
control  computers,  the  effects  of  higher  order  dynamic  modes  and  inherent 
time  delays  have  been  of  great  concern  to  the  aircraft  design  community 
Based  upon  research  addressing  this  issue,  100  ms  has  been  established  in 
the  military  specification  for  piloted-vehicle  handling  qualities  (MIL-F- 
8785C)  as  the  total  equivalent  and/or  pure  time  delay  that  can  be  included 
between  control  input  and  aircraft  response.  This  requirement  is 
independent  of  aircraft  size  and  mission.  This  specification  does  not 
address  the  issue  of  how  much  additional  delay  can  be  added  in  a  flight 
simulator  before  performance,  training,  or  pilot  acceptance  is  degraded.  It 
does  point  out,  however,  that  a  faithful  aerodynamic  model  for  current 
military  aircraft  may  include  a  significant  amount  of  delay  before 
simulation  artifacts  are  added.  To  the  pilot,  the  source  of  delay  is 
largely  irrelevant.  He  only  experiences  the  effect  of  the  total  amount  of 
delay. 

The  one  published  standard  for  cue  synchronization  applies  only  to 
commercial  airline  simulators.  In  Advisory  Circular  AC  120-40A  (FAA,  1986) 
simulator  response  standards  are  specified  for  Phase  I,  II,  and  III 
simulators.  For  Phase  I  simulators,  which  only  permit  certification  of 
certain  landing  tasks,  the  FAA  specifies  that  the  visual  system  response 
time  to  pilot  control  input  shall  not  be  more  than  300  ms  longer  than  the 
actual  aircraft  response.  For  Phase  II  systems,  which  permit  transition  and 
upgrade  certification,  150  ms  is  the  maximum  added  time  delay  for  any  of  the 
display  systems.  In  addition,  the  rule  specifies  that  the  visual  scene 
changes  shall  not  occur  before  the  acceleration  response  of  the  motion  base. 
The  same  synchronization  standard  applies  to  Phase  III  simulators,  which 
permit  all  but  the  line  check,  the  static  airplane  requirements,  and  the 
flight  experience  requirements  to  be  performed  in  the  simulator.  The  reader 
should  note  that  if  the  aircraft  being  simulated  has ' equivalent  or  pure  time 
delays  that  meet  the  above  military  specification,  the  total  delay  in  a 
Phase  III  simulator  could  be  250  ms. 

As  a  means  of  providing  consistent  data  for  military  simulations,  the 
Armstrong  Laboratory  is  preparing  a  guide  entitled  Time  Delay  and  Synchrony 
in  Flight  Simulators  which  will  be  published  in  1992.  This  handbook  will 
focus  on  the  data  collected  in  our  laboratory  and  at  Calspan  Corp. ,  because 
of  the  consistent  experimental  design  and  analysis  procedures  used  in  this 
large  research  effort.  Rather  than  providing  specific  "acceptable  delay" 
numbers,  the  handbook  will  provide  functional  relationships  between  time 
delay  and  (1)  performance,  (2)  transfer  of  training,  and  (3)  handling 
qualities  ratings,  for  different  flight  tasks  and  aircraft  dynamics.  Thus 
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or  training  degradation  he 


the  user  can  determine  what  level  of  performance 
is  willing  to  accept  in  return  for  time  delay. 

Although  we  believe  that  this  is  a  more  useful  .mm.,*, 

-r.n1:-  ldins 

would  suggest  the  following  rules  of ^thUb^^  >Wb™Pt  rhflTwre,  1 


(1) 


™  srss.*^- 

considers  the  delays  included  in  the  aercmodel. 

<2)  the^u^r  delay  *ffects  on  P^ot  performance  in  the  simulator, 
2oo  r  Laer  e  delays  and  «i«*l*tor  delays  should  not  exceed 
.  For  an  aircraft  which  just  meets  MIL-F-8785C,  this  value 
is  equivalent  to  the  expert  consensus  mentioned  above. 

(3)  In/r0m0^e  9°°d  transfer  of  training,  the  sum  of  aeromodel  delays 
and  Simulator  delays  should  not  exceed  300  ms.  y 

(4>  tlme  dSlay  9uideline  can  ^  proposed  with  respect  to 

simulator  sickness  issues. 

<5)  9uidelines  aPP!y  to  transport  and  fighter  aircraft,  since 

military  transport  pilots  often  have  high  task  demands. 
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INTRODUCTION 

The  problem  of  motion  sickness  is  an  old  one  for  the  armed 
forces.  In  its  "classic"  form,  motion  sickness  has  been  studied 
primarily  with  regard  to  air  and  sea  sickness.  However,  as  the 
ability  to  provide  high  fidelity  simulations  of  self-motion  has 
become  more  common,  a  unique  form  of  motion  sickness  has  arisen* 
Visually-induced  motion  sickness  (VIMS).  This  syndrome  is  of  concern 
because  of  the  negative  impact  it  may  have  for  training  vehicular 
control  skills  with  simulation,  and  for  the  incorporation  of  Virtual 
Reality  (VR)  technology  into  operational  and  training  systems. 

VIMS  appears  to  occur  most  often  in  situations  in  which 
observers  view  optical  flow  patterns  that  produce  strong  illusions  of 
self-motion  in  the  absence  of  actual  physical  displacement. 
Occurrences  of  VIMS  in  the  military  have  been  discussed  primarily 
with  regard  to  motion  sickness  in  flight  simulators  (Kennedy 
Hettinger,  &  Lilienthal,  1990;  McCauley,  1984).  in  these  situations, 
pilots  training  in  fixed— base  simulators  may  develop  signs  and 
symptoms  normally  associated  with  classic  motion  sickness  (e.g., 
nausea,  pallor,  sweating)  and  others  which  appear  to  be  unique  to 
simulator  sickness  (e.g.,  eyestrain,  headache,  visual  aftereffects). 

The  prolonged  effects  of  VIMS,  such  as  spatial  disorientation, 
postural  instability,  and  other  perceptual-motor  disturbances,  are 
particularly  critical  in  terms  of  their  implications  for  user  safety 
and  operational  readiness.  While  relatively  rare  in  present  systems, 
these  effects  are  sufficiently  profound  when  they  do  occur  that  some 
U.S.  Army  and  Navy  training  facilities  have  adopted  mandatory 
grounding  periods  following  simulator  training  sessions.  Theso 
effects  may  increase  in  frequency  and  severity  when  more 
sophisticated  VR  systems  for  training  and  mission  rehearsal  begin  to 
come  on-line.  Although  these  systems  may  prove  to  provide  excellent 
training  and  mission  rehearsal  in  most  respects,  their  utility  will 
be  limited  to  the  extent  that  individuals  are  incapacitated  by  their 
use.  Therefore  it  is  critical  to  identify  the  factors  that  promote 
the  occurrence  of  VIMS  in  these  systems  so  that  their  full  potential 
can  be  realized.  r 
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VIRTUAL  REALITY  AND  SICKNESS 

A  large  body  of  research  exists  which  indicates  that  motion 
sickness  can  be  induced  in  stationary  observers  (e.g.,  Andersen  & 
Braunstein,  1985;  Hettinger  et  al.,  1990;  Lestienne,  Soechting,  & 
Berthoz,  1977;  Sharkey  &  McCauley,  1991).  The  common  finding  among 
all  these  investigations  is  that  sickness  occurs  when  the  observer 
experiences  a  highly  compelling  illusion  of  self-motion  referred  to 
as  "vection."  While  the  connection  between  vection  and  visually- 
induced  motion  sickness  has  been  apparent  for  some  time,  there  has 
been  little  research  conducted  to  date  designed  to  isolate  the 
stimulus  factors  that  underlie  this  phenomenon. 

The  occurrence  of  VIMS  poses  signficant  problems  for  the 
development  of  highly  realistic  simulation  technologies  such  as  VR. 
One  of  the  principal  goals  of  VR  is  to  provide  the  user  with  a 
compelling  illusion  of  "felt  presence"  in  the  simulated  environment 
or  "virtual  world."  A  significant  aspect  of  this  felt  presence 
involves  illusions  of  self-motion  which  will  almost  certainly  prove 
to  be  more  compelling  in  future  systems  than  those  experienced  in 
current  simulators.  VR  may-  also  lead  to  disruptions  in  normal 
postural  control  strategies,  a  factor  that  may  also  promote  the 
occurrence  of  VIMS  (Riccio  &  Hettinger,  1991;  Riccio  &  Stoffregen, 
1991). 


RESEARCH  ISSUES 

There  is  a  significant  need  for  research  to  identify  the  factors 
that  promote  VIMS  in  order  to  alleviate  the  problem  while  VR  systems 
are  in  the  development  phase.  However,  the  literature  on  VIMS  and 
simulator  sickness  indicates  that  there  are  multiple  factors  that  may 
contribute  to  the  phenomenon,  as  well  as  multiple,  idosyncratic 
manifestations  of  sickness  (Kennedy  &  Fowlkes,  1990).  These 
characteristics  of  VIMS  make  empirical  investigation  a  difficult 
matter . 

Based  on  the  results  of  experiments  that  have  demonstrated 
relations  between  vection  and  sickness  (e.g.,  Cheung  et  al . ,  1991, 
Hettinger  et  al .  ,  1990)  it  is  reasonable  to  hypothesize  that  any 

visual  display  factors  that  enhance  the  experience  of  illusory  self- 
motion  will  increase  the  probability  of  sickness  in  VR  systems. 
These  may  include  factors  such  as  f ield-.of-view,  spatial  frequency 
content  of  the  visual  display,  and  optical  flow  and/or  edge  rate. 
Sharkey  and  McCauley  (1991),  for  instance,  observed  significant 
effects  of  optical  flow  rate  on  the  incidence  of  sickness  in  a  fixed- 
base  helicopter  simulator.  High  rates  of  optical  flow  resulted  in 
significantly  higher  rates  of  sickness.  It  is  unclear  at  this  point 
whether  optical  flow  exerts  it  effect  on  sickness  by  enhancing  the 
illusion  of  vection,  by  altering  postural  control  strategies,  or 
perhaps  through  some  other  mechanism. 
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An  explanatory  model  of  VIMS  would  be  incomolete  4-  ..  • 

account  of  operator  control  behavior  (Hettinqer P  Kennedv 

simulator atl^n ^  *  Th*  motion  Pattern  which  an  individual 'views^^a 
simulator  and  m  current  VR  svstem*;  i  c  tr,  a  e  s  m  a 

by  the  control  inputs  which  that  individual  introduces  to  the^st""*3 
Experienced  operators  can  be  expected  to  in?  roS?,LVh  system* 

precise  control  inputs  while  novfce  "operators  can  be  ejected”0?" 
introduce  more  variable,  less  precise  control  inputs  The  naturp  nf 
operator  control  activity  is  likelv  to  af f«art  ’  u  Jl.a1.re  of 

andUfo?noth°f  Pot.io.n  sickness  symptomatology  both  foiTthe  operator 
and  for  other  individuals  within  view  of  the  visual  display. 


INTERIM  RECOMMENDATIONS 

Until  the  necessary  research  can  be  conducted  to  provide  desian 
recommendations  to  alleviate  the  occurrence  of  motion  sickness  in  vp 
systems,  an  interim  solution  may  lie  in  the  judicious  use  of  this 
technology  (McCauley  &  Sharkey,  1991).  As  part  of  the  US.  Navy's 
program  of  research  on  simulator  sickness,  a  set  of  guidelines  for 
?QR7!at°-?KUSe  to.^lleviate  the  problem  was  developed  (Kennedy  et  al., 
future  VRh s y s t e m s^ 6 1 1 n e s  may  also  Prove  to  be  beneficial  to  users  of 

„  ,  Tbe  key  recommendation  for  the  use  of  these  systems  may  be  to 
take  advantage  of  the  human  capacity  for  adaptation  to  altered  or 
rearranged  visual  perception  (Welch,  1978).  Simulator  sickness 
research  indicates  that  incapacitation  is  most  likely  to  occur  durinq 
initial  exposures  to  a  novel  simulator  (e.g.,  Uliano  et  al .  ,  1986)  or 
simulator  scenario,  particularly  when  there  is  a  high  level  of 
apparent  motion  present  (e.g.,  high  rates  of  optical  flow,  frequent 
changes  in  acceleration).  By  minimizing  the  level  of  activity  in 
early  exposures  to  VR  systems,  one  increases  the  likelihood  that 
adaptation  will  guard  against  subsequent  problems  with  sickness. 


CONCLUSIONS 


Research  that  has  been  conducted  to  date  strongly  suggests  that 
future  VR  systems  for  flight  simulation  and  mission  rehearsal  may 
produce  high  levels  of  motion  sickness.  This  prediction  is  made  on 
the  basis  of  the  observation  that  VIMS  tends  to  occur  most  frequently 
in  those  situations  in  which  individuals  experience  highly  compelling 
illusions  of  self-motion  in  the  absence  of  actual  physical 
displacement.  VR  technology  seeks  to  maximize  the  felt  presence  of 
the  user  m  a  virtual  environment,  including  the  phenomenological 
concomitants  of  self-motion.  An  undesired  side-effect  of  this  hiqh 
degree  of  realism  may  be  an  unacceptably  high  rate  of  sickness. 


Recent  research  indicates  that  those  factors  that  enhance 
illusions  of  self-motion  and  affect  postural  control  activity  may  be 
the  critical  elements  in  VIMS.  To  the  extent  that  we  are  able  to 


better 
it  may 


understand  the  contribution  of  these  factors  to  the  problem, 
be  possible  to  influence  the  design  of  VR  systems  to  minimize 
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its  occurrence.  In  the  meantime,  the  only  effective  approach  to  the 
problem  may  lie  in  the  cautious  use  of  the  technology. 
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THE  EFFECT  OF  VISION  ON  MANUAL  CONTROL 
AND  SPATIAL  ORIENTATION 


Fred  H.  Previc 

Flight  Motion  Effects  Branch 
Crew  Technology  Division 
Armstrong  Laboratory 
Brooks  AFB  TX  78235-5000 

The  overall  objective  of  this  research  is  to  determine  how  ambient  * 
visual  information  affects  spatial  orientation  and  its  perceptual  (e.g., 
vection)  and  motor  (e.g.,  postural  and  manual  control)  concomitants.  Previous 
research  has  shown  a  relationship  between  whole-body  vection  (V)  and  visually 
induced  postural  change,  although  the  latter's  onset  occurs  considerably 
before  the  perceptual  experience  of  self-motion  opposite  to  the  moving  scene. 
Although  visually  induced  manual  and  postural  changes  exhibit  many 
similarities,  they  appear  to  differ  in  their  frequency  response  and  in  other 
respects.  Since  little  research  exists  concerning  how  ambient  vision  affects 
manual  control  (MC) --despite  the  fact  that  it  represents  the  motor  system  used 
by  the  pilot  to  control  the  aircraft- -we  have  focused  upon  this  system  in  our 
own  research.  We  also  have  assessed  the  effects  of  visual  scenes  on  the 
somatogravic  illusion  (SGI),  a  major  source  of  spatial  disorientation  mishaps. 

In  the  first  study,  we  investigated  which  sectors  of  the  visual  field 
most  greatly  affect  MC,  V,  and  induced  motion  (IM)  of  a  central  attitude 
display  opposite  to  a  moving  background  (i.e.,  the  Duncker  illusion).  Previous 
research  (Heckman  &  Howard,  Perception.  1991;  in  press)  suggests  that  whereas 
V  is  dominated  by  far  visual  motion,  IM  may  be  more  influenced  by  visual 
motion  in  the  same  plane  as  the  stationary  central  display.  We  have 
hypothesized  that  the  bias  of  the  stick  in  the  direction  of  background  scene 
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motion  during  MC  tasks  may  be  more  related  to  the  attempt  of  the  subject  to 
"null-  preconsclously  perceived  IM  than  to  a  compensation  for  V.  Hence,  manual 
biases  are  hypothesized  to  be  dominated  by  the  same  sectors  of  the  visual 
field  that  give  rise  to  IM  rather  than  V. 

In  one  experiment,  twelve  subjects  viewed  a  54  x  44  deg  visual  image 
that  was  composed  of  50  dots  moving  in  the  roll  plane  at  a  velocity  of  25 
deg/s.  Subjects  viewed  the  dots  while  they  tried  to  keep  an  unstable 
centrally  located  target  that  resembled  an  attitude  display  at  a  "wings-level " 
position.  The  background  dots  were  located  either  in  the  same  depth  plane  as 
the  fixated  central  display,  or  16*cm  in  front  of  or  behind  it.  In  some 
conditions,  the  dots  moved  in  a  single  plane,  whereas  in  others  they  moved  in 
different  depth  planes  in  opposite  directions.  In  a  second  experiment,  the 
background  roll  motion  involved  a  total  of  80  squares  which  were  located  in 
the  same  depth  plane  as  the  “attitude"  display,  but  which  were  confined  to 
enther  the  central  (0-57  deg)  or  peripheral  (58-115  deg)  visual  field  .  As  in 
the  first  experiment,  the  texture  elements  moved  in  the  same  direction  on  some 
trials,  and  in  conflict  with  one  another  on  the  others.  In  both  experiments, 

the  manual  bias  of  the  stick  was  calculated,  along  with  subjects'  ratings  of  V 
and  IM. 

The  results  of  the  initial  experiment  showed  that  both  IM  and  MC  biases 
were  strongly  elicited  by  the  coplanar  and  far  dots,  but  were  dominated  by  the 
far  dots  in  the  coplanar-far  conflict  condition.  Conversely,  image  motion  in 
front  of  the  fixated  central  display  had  much  less  effect,  either  in  the 
conflict  conditions  or  in  isolation.  Unfortunately,  the  small  visual  field 
used  in  the  depth  experiment  may  have  impaired  the  perception  of  V,  which  was 
not  significantly  different  from  zero  in  any  condition.  In  fact,  the  results 
the  eccentricity  experiment  revealed  that  V  is  almost  completely  dependent 
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on  the  peripheral  visual  field  stimulation,  with  very  little  self-motion 
reported  during  the  central  condition.  As  expected  from  the  first  experiment, 
however,  central  roll  motion  produced  both  good  MC  biases  and  IM. 

In  combination,  the  results  of  the  two  laboratory  studies  suggest  that 
MC  biases  are  highly  related  to  the  experience  of  IM,  but  may  differ  in  some 
respects  from  V  and  postural  change,  which  involve  whole-body  perceptual -motor 
reactions.  Contrary  to  previous  research,  however,  it  appears  that  all  of 
these  visual  orientational  percepts  are  dominated  by  far  visual  inputs, 
presumably  because  large-scale  motion  in  near  vision  (i.e.,  peripersonal 
space)  is  not  a  reliable  indicator  of  self-motion.  But  far  visual  dominance 
may  also  arise  because  we  typically  encounter  nearer  objects  against  a  more 
distant  visual  background  during  MC  and  the  oculomotor  processes  associated 
with  it  (Previc,  Behav  Brain  Sci  1990;  13:519-542). 

The  above  laboratory  results  may  be  relevant  for  understanding  the 
findings  of  a  second  study  that  investigated  visual  scene  influences  over  the 
SGI.  The  SGI  occurs  whenever  an  inertial  force  created  by  takeoff  or  other 
aircraft  acceleration  is  misconstrued  as  a  shift  of  the  aircraft's  position 
relative  to  gravity.  In  the  presence  of  reliable  visual  information,  the 
pilot  almost  never  experiences  the  SGI,  because  he  is  able  to  correctly 
attribute  the  inertial  force  to  the  aircraft  acceleration  and  thereby 
dissociate  it  from  the  sustained  gravity  vector. 

We  conducted  this  experiment  in  the  Armstrong  Laboratory's  Vertifuge, 
which  produced  an  SGI  of  30  deg  by  means  of  centripetal  acceleration  (5.67 
m/s2)  and  its  consequent  centrifugal  force  directed  in  the  +GX  direction 
(i.e.,  toward  the  front  of  the  subject).  Nine  subjects  (seven  of  whom  were 
pilots)  viewed  head-fixed  he! met -mounted  visual  scenes  that  subtended  90  x  60 
deg  and  depicted  visual  acceleration  over  a  shoreline  for  30.  The  scenes  were 
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composed  of  various  cues  In  Isolation  and  In  combination,  including  texture, 
horizon,  perspective,  and  color.  Subjects  Indicated  their  perceived  position 
of  "down"  during  the  final  7  s  of  each  trial  using  a  down-pointer,  and  also 
rated  the  magnitude  of  linear  V  induced  by  each  scene. 

No  significant  reduction  in  the  SGI  was  observed  in  the  eight  visual 
conditions  relative  to  the  eyes- closed  condition.  However,  an  overall 
reduction  in  the  SGI  of  at  least  20%  was  observed  in  four  of  the  nine 
subjects.  Modest  V  was  experienced  in  the  visual  conditions  that  included 
texture  flow,  but  V  was  not  correlated  with  the  ability  of  the  various  scenes 

to  reduce  the  SGI,  even  in  those  subjects  that  showed  the  greatest  visual 
effects. 

Because  the  scenes  were  head-fixed--even  though  subjects'  heads  were 
loosely  restrained  and  head  movements  were  kept  to  a  minimum- -and  because  of 
other  optical  distortions  and  limitations,  subjects  did  not  perceive  the 
visual  scenes  as  adequately  representing  the  out-the-window  visual  world. 
Based  on  the  laboratory  findings  with  MC,  IM,  and  V,  one  of  the  most  critical 
factors  may  be  the  perceived  depth  of  the  visual  scene.  Had  our  scene  truly 
appeared  to  emanate  from  a  great  distance  beyond  the  cockpit,  it  would  have 
likely  produced  a  much  greater  reduction  of  the  SGI. 
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FLIGHT  SIMULATOR  SIDE  EFFECTS 
AND  VISUAL  DISPLAYS  EVALUATION 


Harold  H.  Warner,  PhD,  UDRI 
Gary  L.  Serfoss,  1  Lt,  USAF 
Todd  M.  Baruch 


Armstrong  Laboratory, 
Aircrew  Training  Research  Division, 
Williams  AFB,  A2 


Objectives : 

The  primary  purpose  of  the  investigation  was  to  determine 
the  frequency  and  severity  of  simulator  sickness  occurrences 
associated  with  the  use  of  the  Display  for  Advanced  Research  and 
Training  (DART)  and  the  Limited  Field-of-View  Dome  (LFOVD)  visual 
simulation  systems  during  normal  flight  operations.  A  subjective 
visual  display  evaluation  of  the  two  systems  was  conducted  as  a 
secondary  objective  to  identify  any  significant  display 
deficiencies. 

Problem: 

The  Dart  and  LFOVD  visual  simulation  systems,  which  are 
located  at  the  Armstrong  Laboratory,  Aircrew  Training  Research 
Division  (AL/AZ) ,  were  acquired  to  provide  advanced  testbeds  for 
the  development  of  flight  simulator  visual  system  design 
specifications.  Following  some  recent  demonstration  flights, 
however,  physiological  side  effects  were  reported  in  conjunction 
with  the  use  of  the  DART  visual  system.  To  determine  if 
simulator  sickness  might  be  a  persistent  and  debilitating  problem 
for  DART  users  during  normal  simulator  operations,  the  present 
study  was  conducted.  The  LFOVD  visual  simulation  system  was 
included  in  the  evaluation  to  compare  the  incidence  of  simulator 
sickness  between  the  two  visual  displays. 

Additionally,  the  design  characteristics  of  neither  visual 
display  had  been  subjected  to  a  systematic  engineering  or 
behavioral  evaluation.  It  appeared  this  investigation  would 
provide  an  ideal  opportunity  to  concurrently  conduct  such  an 
evaluation.  Further,  because  the  properties  of  the  displays 
could  influence  the  incidence  of  simulator  sickness,  as  well  as 
the  utility  of  the  visual  systems  in  R&D  programs,  it  appeared 
information  from  such  a  display  evaluation  could  enhance  the 
simulator  sickness  investigation. 
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Method : 


a.  Equipment 

in  the  study.  The^AR^provides^  ^®“lati°n  systems  were  used 
rear-projection  screens  ?ha^  su?rSu?S  J  ■  °f ,  eight  Pentagonal 
Computer  generated  imagery  is  oroiec-t-od  S1®ulated  F-16  cockpit, 
commercial  BARCO  Electronic  cathodf^  °!?t°  the  screens  with 
The  eye-to-screen  distance  is  !?  I  incJL^,  Projectors. 

Of-vxew  (FOV)  is  300  degrees  horizontal  Sv  tnn  Jhe  t0tal  field~ 
The  LFOVD  employs  a  head-rr>nn?I?S  1  by  200  de9rees  vertical. 

display  that  includes  a  h5S-«^li?L;r?r°f"interest  <AOI> 
resolution  wide-angle  backaro^nd  b  ?urr°unded  by  a  low 

of  140  degrees  horizontal  by  60  degreis^lrtLi?^*™*1160115  FOV 
Regard  is  approximately  32  0  degree!  hSJi™n?  ?  F  The  Field~of- 
vertical.  The  computer  gener!?£d  1  by  120  de9rees 

dSt:?dd^Lp^?r5^e?anrE^;trKielFaS^°fSrj4!“d-by  the 

fully  operational  P-1.A  simulator  cocK^t'S^nc^L^d^S^e  * 


b.  Subjects 

undergraduate°pi iot^rainino^r^r S '  Jir  Force  T'37  *-3S 

a  .  first  phase  ?o  ?L  S?iSy  9  p7lots.  <Ips)  were  used  as 

eight  current  or  former  militarj  SffoJf  ph?se  included  a  group  of 
recently  flown  or  wS^J^fLIm^Jit^  “* 


c. 


Experimental  procedures 


once  in°the1LFOVDUb3fth  "ss  tested  twice,  once  in  the  DART,  and 

flight?  5®  2  iaS  i??s!  a  two  week  interval  between  each 

simulator  familiarizati??  flight*5  <a)  a.5"Ilinute 

formation  flight,  (c)  a  20-minuti  loi-altitid?  single-Shin  road 
reconnaissance  flight  rdi  a  on  7  single  ship  road 

fl  ync'  'a'  a  20-minute  low-altitude  formation 

Ji$£*ito1.s£rs!r£  in  a  narr°w-  »&;»» 

Sr3Kli 

and  30  minutes  after  Xch ??igS?  tSd  °rS'  lraediately  after, 

with  theui^se?;rdiStaeisae;;is??enw?e  ?;nd?ceed  ^rrentiy 
e?sepiai;iaa1sssKi::nstan?hioPas?:?“risplay  ^^**quaZr°ihe 

rate  a  wide  ranqe  of  vi  <=;,,=  t  i  addition,  they  were  asked  to 

range  or  visual  display  characteristics  upon 
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completing  their  flight  and  describe  any  display  deficiencies 


Results: 

Since  data  collection  was  not  completed  until  11  SEP  91  only 
limited,  preliminary  results  are  available.  Some  of  them  are: 

(1)  Of  the  16  IPs  who  flew  both  simulators,  only  one  experienced 
simulator  sickness  symptoms  in  either  simulator  to  the  extent 
that  they  could  not  complete  the  50  minutes  of  flight.  This 
person  was  forced  to  end  the  mission  prematurely  in  both 
simulators,  stopping  at  16:16  minutes  of  flight  in  the  DART  and 
at  38:55  minutes  of  flight  in  the  LFOVD ;  (2)  Of  the  8  pilots  in 
phase  2,  three  were  unable  to  complete  50  minutes  of  flight  in 
the  DART  due  to  simulator  sickness,  stopping  at  12:17,  24:52,  and 
26:42  minutes  of  flight.  Two  of  the  three  individuals  who  did  not 
complete  the  mission  in  the  DART  were  also  unable  to  complete  the 
50  minutes  of  flight  in  the  LFOVD  due  to  simulator  sickness, 
stopping  at  16:56,  and  30:00  minutes  of  flight. 

Preliminary  inspection  of  the  symptom  checklists  completed 
by  each  pilot  seem  to  indicate  no  difference  in  the  symptoms 
experienced  by  the  pilots  in  the  DART  or  LFOVD.  It  also  appears 
that  cases  of  severe  simulator  sickness  are  due  to  individual 
susceptibility  not  to  simulator  type  in  this  instance.  Finally, 
as  can  be  seen  in  attached  Figures  1  and  2,  the  mean  comfort 
rating  for  each  simulator  is  very  similar;  the  ratings  also 
appear  relatively  low,  with  a  ”1"  on  the  comfort  scale 
symbolizing  no  discomfort  caused  by  the  simulator,  and  "7" 
symbolizing  severe  discomfort. 

Work  Remaining : 

Data  analysis  will  be  completed  and  a  Technical  Report  will 
be  published. 
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EAN  COMFORT  RATINGS-' '( 

DART  vs.  LFOVD 


§  of  Minutes  into  Flight 


FLIGHT  SIMULATION  VISUAL  RESEARCH  BY  THE  CREW  ctatioki 
RESEARCH  and  DEVELOPMENT  mANCHOF  U  r™ 
NASA  AMES  RESEARCH  CENTER,  MOFFETT  FIELD,  CALIFORNIA 


Robert  T.  Hertnessy 


inc. 

simulator?  f 

touch  ?Jlmet  2?unJed  Display,  (WFOVHKD)  two  cockpits  with  colo? 
touch-screen  displays,  two  four-axis  hand  controllers  Der  ' 

cockpit,  and  a  speech  recognition  and  production  system  other- 
elements  of  the  facility  include  threesuppSrt  stations 'to 
ontrol  other  friendly  and  hostile  aircraft,  a  central  station 
radio^ei^n  headquarters  and  multiple  other  ground  units  via 
anfgroSXveMciS3'  “*  *  C°mpleX  ^  defense  weapons 

,1*3,  WFOVHMD  has  a  field  of  view  of,  120  degrees  horizontally 
by  60  degrees  vertically.  The  resolution  is  5  -  6  minutes  of 
arc.  A  high  resolution  inset,  24  degrees  horizontally  by  19 
degrees  vertically  has  a  resolution  of_2  minutes  of  arc  or 
SUv*.,  luminance  is  greater  thanC|0^£dot-Lamberts.  The  infra- 
red  head  tracking  system  allows  an  unlimited  field  of  regard  and 
more  than  one  foot  of  translatory  head  movement  in  any  direction. 

The  CSRDB  research  staff  has  performed  a  number  of  studies 
ranging  in  complexity  from  two-hour,  full-mission  studies 
involving  multiple  aircraft  to  tracking  of  air  targets  for  25 
seconds.  The  following  describes  three  recently  completed 
studies  directly  bearing  on  visual  simulation.  Future  plans  are 
also  surveyed. 

Cue  Augmentation  fpr  Night  Vision  Detection  of  Obstacles  fCANnm 

During  the  build-up  of  U.S.  forces  in  Saudi  Arabia  preceding 
operation  Desert  Storm,  several  helicopters  were  lost  during 

?iS5t%°peration*.when  the  crew  was  using  Night  Vision  Goggles 
(NVGs) .  The  primary  cause  is  thought  to  be  loss  of  contrast 
among  the  sand  dunes  that  prevented  the  pilots  from  detecting 
rising  terrain.  The  U.S.  Army  Aviation  Systems  Command' (AVSCOM) 
began  to  seek  short-term  solutions  to  the  Saudi  night  pilotage 
‘  Army  center  for  Night  Vision  and  Electro-Optics 

(CNVEO)  recommended  the  use  of  two  narrow-beam  aiming  lights  as 

of  ^di^abi^6031®111  t0  provide  terrain  cuing  in  the  sand  dunes 


25 


strutTheT£°t T  a  •**» 

5.0  degree  depression  angle  resDectiveiv^f^i*  a  1,0  de9ree  and 

'M, .?SS^^S1SP*sst«*a2iSg1:si 

establishfdainSth2d?;e?rttit“d?S  ®nd  visibility  conditions  was  not 
and  time-to-collisior^warning^f  tEe^hti 

angles.CU^ng  "=  *=  *“*»rt“*  to  I&3L 

In  November,  1990,  The  U.S.  Army  Aeroflightdynamics 

ra^\  (AF°D)  initiated  a  program  of  simulation  using  the 
CSRDF  to  determine  the  efficacy  of  Cuing  Augmentation  for  nvg 
Detection  of  Obstacles  (CANDO) .  The  CSRDF  was  modified  to 
represent  the  essential  characteristics  of  NVGs  by  masking  each 
eye  channel  to  provide  a  circular,  40  degree  field  of  view,  and 
rendering  the  scene  in  monochrome  green.  The  high-resolution 
inset  was  not  used.  Geographic  areas  and  environmental  lighting 
conditions  were  chosen  to  produce  marginally  visible  terrain  with 
some  of  the  features  of  Saudi  Arabian  desert,  i.e.,  no  vegetation 
and  rolling  terrain.  The  simulation  of  the  cuing  lights  required 
parallel  processing  on  a  separate  computer,  holding  a  reduced 
visual  data  base,  to  determine  the  terrain  intercept  points  of 
the  lights. 


Between  November  1990  and  May  1991  over  70  different 
combinations  of  cuing  lights,  altitude  and  speed  profiles,  and 
visibility  conditions  were  simulated  in  the  CSRDF.  The  cuing 
light  arrangements  were  evaluated  in  short  night  mission  flight 
profiles  to  determine  the  collision  warning  lead-time  afforded  to 
the  pilots,  ease  of  interpretab ility,  and  workload  associated 
with  each  of  the  cuing  light  arrangements. 


In  the  last  evaluation  series,  four  of  the  most  promising 
light  configurations  were  evaluated  using  six  U.S.  Army  rotary 
wing  pilots.  The  four  configurations  are  called  the  Vertical  (2 
lights),  the  Horizontal  (2  lights),  the  T-Cross  (10  lights)  and 
the  SLICK-3  (7  lights) .  Changes  in  the  relative  position  pf  the 
lights,  as  well  as  the  number  of  lights  visible,  indicated 
whether  the  terrain  was  rising,  level,  or  dropping.  A  no-light 
condition  was  also  used  as  a  control.  The  primary  measure  was 
ratings  by  the  pilots  on  usefulness  and  ease  of  interpretation. 
Number  of  crashes,  and  altitude  maintenance  were  also  used  as 
measures . 


*he  nuirLber  of  total  crashes  was  to  low  to  be  statistically 
ful.  The  altitude  measures  have  not  been  fully  analyzed.  The 
subjective  ratings  were  found  to  be  statistically  reliable. 

Pilots  rated  the  SLICK-3  and  Vertical  configurations  more  useful 
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££  ^tabH  •  th™et!Sro^raJ h"°nf i9U;ati0n  «•  «t.d  as 

not  distinguishable  among  themselves*!?!  which  were 

commented  that  except  fo?  th^VertiLl aiZZZZ?***?*^1** ‘  Pilot 
lights  ware  aisad  tic  fa? 

Studies  of  simulator  sicjmAse 

-ASSESSES.  « .  =f 

jsHKss; 

ize.  The  overall  incidence  of  symptoms  is  low  about-  ini 
the  frequency  of  extreme  symptoms  is  much  lower' 

isYloSl09^Cai  fechai?isms  are  poorly  understood  and  the  incidence 

e^e?T;enianvt0rHSiCkneSS  iS  &  diffic^t  phenomenon  to  2?udy 

tSTSSi.—  SUCCeSSfUl  Work  has  «"•*«*  bean 

Simulator  Induced  Alteration  of  Bead  Movements  (8IAHM)  in  the  / 

Field  J?VS?  ie/4™C7?nC!:rn  Was  axP^essed  about  the  relatively  small 
Field  of  View  (FOV)  of  many  military  flight  traininq  simulators 

th!i?°heJdnbWaS  thaiKthe  pilots  w^ld  learn  not  to  scan  by  moving 
36  dLJSd^eTSe  t^®re  was  no  Scene  except  on  the  central  48  by 
hLfl9  JlsPlay-  The  major  problem  was  that  the  learned  bad  Y 
habit  may  transfer  to  aircraft.  This  concern  has  evaporated  with 
the  advent  of  wide  FOV  displays.  More  recently,  a  concern  was 
Pi;!-ots  suffering  from  simulator  sickness  may  not 
move  their  heads  m  an  attempt  to  ameliorate  the  symptoms.  The 
problem  is,  again,  that  this  behavior  may  transfer  to  flight  in 
the  actual  aircraft.  y 


r.CT)r,t.D^: ring  March  and  April  1991  a  study  was  performed  at  the 
CSRDB  to  determine  if  simulated  flight  (presumably  inducing 
simulator  sickness)  would  cause  a  subsequent  alteration  of  head 
movements  in  an  actual  aircraft.  The  design  was  simple.  Six 
Army  pilots  performed  two  maneuvers  over  a  taxiway  on  one  day, 
performed  the  same  maneuvers  in  the  simulator  the  next  day, 

*>!£°re  a  c?ase  lntended  to  induce  simulator  sickness,  and  then 
performed  the  same  maneuvers  again  afterwards.  The  pilot  then 
went  straight  to  the  flightline  outside  and  repeated  the 

helic°Pter-  Head  movements  could  be  measured  in 
both  the  simulator  and  the  aircraft.  Ratings  of  simulator 
sickness  were  taken  before  and  after  each  real  flight  as  well  as 
before,  during  and  after  the  simulation  flight. 

,  The  two  test  maneuvers  were  designed  to  involve  substantial 

thIdn??o?m?ntS*  T?®  flrst  maneuver,  called  the  Sawtooth  required 
the  pilot  to  move  laterally  across  the  taxiway  to  the  left  to 
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arrive  °ver  a  taxiway  light.  The  pilot  then  reversed  course  and 

ffXht  la'Grally:.and  f ?rward '  to  the  next  taxiway  light  on  the 
light.  IXiring  the  entire  maneuver  the  pilot  was  to  maintain 

heading  aligned  with  the  taxiway.  The  maneuver  continued  for  ten 

?KirS4.°£u^aX1WaV  lx9hts .  The  pilot  then  flew  straight  back  to 
the  starting  point  and  repeated  the  maneuver  for  a  second  time. 
The  second  maneuver,  called  the  S-tum,  required  the  pilot  to  do 
a  series  of  S-tums  passing  across  each  pair  of  taxiway  lights  a 
90  degree  angle  to  the  taxiway.  This  maneuver  was  performed 
immediately  after  the  Sawtooth  maneuver  and  was  also  performed 
twice.  The  maneuvers  were  performed  in  a  AH-i  Cobra  helicopter 
with  a  safety  pilot  occupying  the  front  seat. 


The  same  pattern  of  maneuvers  was  performed  the  next  day  in 
the  CSRDF.  The  pilot  then  chased  another  helicopter  following  a 
pre-recorded  flight  path  for  about  twelve  minutes.  The  Sawtooth 
and  S-tum  maneuvers  were  then  repeated  in  the  simulator.  Within 
ten  minutes,  the  pilot  was  in  the  Cobra  helicopter  doing  the  same 
two  maneuvers. 


The  results  were  interesting.  The  two  maneuvers  developed 
"to  test  the  head-movement  hypothesis  were  found  to  be  extremely 
nauseogenic  in  the  simulator.  None  of  the  pilots  were  able  to 
complete  the  full  simulator  flight  sequence.  All  voluntarily 
terminated  the  flight  due  to  the  imminent  chance  of  vomiting. 

The  chase  maneuver,  intended  to  induce  simulator  sickness,  was 
reported  by  the  pilots  to  be  a  relief.  The  Sawtooth  and  s-tum 
maneuvers  did  not  produce  any  reported  symptoms  in  the  aircraft. 
Although  all  the  pilots  had  to  terminate  the  simulator  flight, 
each  was  able  to  continue  to  the  actual  flight  maneuvers  on  the 
second  day.  Apparently  the  few  minutes  between  the  simulator  and 
actual  flight,  plus  the  short  walk  across  the  flightline  were 
enough  to  reduce  the  symptoms  to  the  point  that  the  flight 
maneuvers  could  be  performed. 


The  head  movement  data  from  the  before  and  after  flights  in 
the  simulator  have  been  graphed  for  inspection  but  not 
quantitatively  analyzed.  However,  even  from  inspection  it  is 
clear  that  the  amplitude  of  head  movements  was  much  reduced  in 
the  after-simulation  flight  relative  to  the  pre-simulation 
flight.  In  other  words,  the  data  appear  to  support  the 
hypothesis  that  simulator  sickness,  or  at  least,  the  simulator 
experiences  described  previously,  do  influence  head  movements. 
However,  a  control  is  needed  to  rule  out  order  effects. 

This  study  accomplished  quite  a  bit.  It  was  the  first  study 
of  simulator  sickness  to  demonstrate  that  the  sickness  occurs 
only  in  the  simulator  and  not  in  the  aircraft.  Second,  the  SIAHM 
maneuvers  were  discovered  to  be  reliable  inducers  of  simulator 
sickness.  Heretofore,  the  chance  of  various  maneuvers  inducing 
simulator  sickness  was  small.  In  the  future,  these  maneuvers  can 
be  used  to  induce  simulator  sickness  to  study  other  independent 
variables.  Third,  while  tentative,  the  results  show  that 
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operational 


significance?*11*53  haVe  deleterious  effects  of 

^^^cSaVo^tS^ct^r^^  sickness 

SIMM  work  addressed  soSe  of  lsvels-  The 

fiS^SSn-iiS:  theoretical^ssue*- 

Council  and  NASjThaM  e^oniSJed^Seting^^exS!,^11^  Research 
because  there  is  a  co S?T W^Li  *  fimulator  sickness  occurs 

Sl^Lr^^rSrS^*  risTto^e  S^CTS*' 

^  V^^’s^^iSTSiSiSs^s1-  MikS? one 

based  simulator,  such  as  the  CSRDF,  the  body-sinse  cue  Mst  be 

wav  it^olnrt  visual  cue  to  motion  could  be  quantified  in  some 
Way4  would  be  a  start  for  defining  cue  conflict.  To  this  end 

cai?^YrVaI  ?°f7?UCtfd  Using  the  CSRDF  to  determine  if  a  measure 
V^SUv1  ?low  • (GVF)  would  correlate  subjective, 
performance,  and  physiological  measures  of  simulator  sickness. 

in™  I”  the  CSRDF'  angular  visual  flow,  and  changes  in  visual 

aircraft  *?%?**•?'  altitude  and  maneuvering  of  the 

5J*.M,Gl0bali.V**I??1  Flow  1S  operationally  defined  as  the 
ra^°J°f  the  eye  hei9ht  divided  by  airspeed.  In  the  experiment 
Ga  ad  VISFL0W»  Aray  rotary-wing  pilots  were  required  to  chase 
le^d  aircraft  for  approximately  45  minutes.  The 
movement  of  the  lead  aircraft  was  produced  by  a  replay  of  a 

fii2£\Sath  f1CT\-J?y  anotber  army  Pilot.  The  chase  course  was 

“?7ioo  ????  lltllual*  pating  pilots  at  a  hi9h  <40°  £t‘>  and 

__  Duri?g  each  run  the  aircraft  positions,  velocities  and 

theeoi?o^°nwer;re  re^?rded*  Similar  measures  were  recorded  for 
e  Pilot  s  head  position.  Also,  before,  during  and  after  the 
run  each  pilot  provided  a  self-report  of  discomfort  on  a  one  to 

!™???<;Cale-  BefoJe.and  aftar  each  run,  tests  of  po??u?a? 
equilibrium  were  administered.  Physiological  measures  were  taken 
from  each  pilot.  These  included  hiart  rlti?  va«?  ”ne 
respiration  rate,  skin  conductance  and  temperature,  peripheral 
mo?mfy?W  and  an  electrogastrogram  (EGG)  Lasu?e VSSSSi 
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TorthtLS^  K*S  ralf  sub^^vr«Sr?fv^^out1S^r- 

if -ihf  h1?1?  altltude,  low  GVF  value,  and  about  five  for  fhf 
altitude,  high  GVF  value.  None  of  the  postural  e^ilibriS 
measures  showed  any  differences  as  a  function  of  I^T  * 

Electrogastrogram  (EGG)  stomach 

motility  was  significantly  related  to  subjective  discomfort 
However,  average  values  do  not  give  a  complete  picture  The 
h?oSUrS  1£\hf?hl*  idiosyncratic .  For  some  individuals  there  is  a 
Silre  !r;^os?nn^eT“n  EGG  disoo"fort-  «»iX.  for  others 


i-h^  ^?fk«?ni^fntifi?ation  of  cue  conflict  will  continue.  In 
the  fall  of  1991,  a  simulator  sickness  study  will  be  performed 

t •  the*.V!rtifal  motion  simulator  at  NASA  Ames  Research  Center. 
In  this  study  the  SIAHM  maneuvers,  which  were  found  to  be  highly 

WiX1  be  tl0Wn^ith  and  without  the  *°tion  base  active 
to  determine  how  much  motion,  per  se,  contributes  to  the  presence 
or  absence  of  simulator  sickness.  ^ 


Future  Plans 


Visually  related  research  is  planned  for  the  future.  At 
present,  a  study  of  air-to-air  tracking,  using  head  and  hand  is 
underway.  Unconventional  displays  of  sensor  images  will  be 
evaluated  for  their  efficacy  in  initially  acquiring  and 
maintaining  track  of  targets.  An  interesting  side  development, 
now  nearly  complete,  is  an  acoustic  head  tracker  and  display  for 
laboratory  use.  1 


.  Northrop  Corporation  is  developing  a  sensor  for  Army 
helicopters  that  can  detect  wires  and  other  flight  obstacles. 

The  CSRDB  is  tasked  with  development  of  symbology,  or  other 
means,  for  informing  the  pilot  of  the  output  from  the  Obstacle 
Avoidance  System  (OASYS) . 

In  cooperation  with  the  Aerospace  Human  Factors  Division  at 
NASA  Ames  Research  Center,  a  study  of  the  effect  of  stereopsis  on 

performance  of  helicopter  flight  maneuvering  will  be  conducted 
early  m  1992. 
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CUING  AND  SCENE  CONTENT  REQUIREMENTS  FOR  LOW-LEVEL  FLIGHT 

James  A.  Kleiss 

University  of  Dayton  Research  Institute 
Armstrong  Laboratory,  Williams  AFB,  Arizona 

.  T  ITT: 

fclGsl°  fhe 4.^orld  displayed  to  pilots.  Computer  image  generators 

atlln^al^  t^fy,  l^e  "SitS 

S  s  SsKS 

tate  of  the-art  CIGs.  It  is  of  interest  to  note  that  even  simnl p 
scenes  composed  of  large  triangular  or  rectangular  terrain  faces 
W  With  ?  f6W  Simple  three-dimensional  objects  provide 
f^f£  visual  cue  information  for  pilots  to  perform  various 

addrl™?^011^  lnil?1.inal  level  °f  competence.  The  present  research 

‘JScKteES.  ^  SCenSS  ^  be  enhMCed  usi"9 

An  important  consideration  is  that,  despite  current 
technological  sophistication,  CIGs  remain  limited-capacity 
processors.  An  increase  in  one  type  of  simulator  scene  detail  may 

^vc°ff\bXa,'eCreaSe  iP  an°ther.  One  line  of  research  being 
pursued  at  the  Aircrew  Training  Research  Division  of  the  Armstrong 
Laboratory  investigates  possible  tradeoffs  among  various  types  of 
simulator  scene  detail.  Previous  experiments  show  that  performance 
of  a  variety  of  low-level  flight  tasks  improves  with  increases  in 
the  density  of  three-dimension  objects  in  a  simulator  scene.  To 
optimize  density,  objects  have  frequently  been  simple  in  shape. 
For  example,  three-sided  pyramids,  or  tetrahedrons  (the  simplest 
three-dimensional  shape) ,  are  common.  One  question  concerns 
whether  cue  effectiveness  increases  when  objects  are  made  more 
detailed  and  realistic  in  appearance.  Results  to  date  consistently 
show .  that  detection  of  change  in  altitude  is  no  better  with 
detailed/ realistic  objects  than  with  simple  tetrahedrons. 
Performance  improves  with  increases  in  object  density,  however,  up 
to  the  maximum  possible  level  of  175  objects/square  mile.  As 
realistic  objects  are  more  demanding  of  CIG  processing  than 
tetrahedrons,  available  resources  may  be  used  most  effectively  by 
maximizing  object  density  rather  than  object  detail/realism. 

In  a  recent  investigation,  object  detail/realism  and  object 
density  were  evaluated  in  the  context  of  a  complex  cell  texture 
.  °n  the  terrain  surface.  As  before,  no  advantage  was 
obtained* for  detailed/real istic  objects.  Performance  did  improve 
with  complex  texture  on  the  terrain  surface.  Although  texture 
alleviated  poor  performance  at  low  object  densities  to  some  extent, 
best  performance  was  still  obtained  with  the  highest  density  of  175 
objects  per  square  mile.  Complex  texture  appears  to  be  most 
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effective  when  used  on  terrain  surfaces  rather  than  on  individual 
objects.  However,  texture  does  not  eliminate  the  need  for  high 
levels  of  object  density. 


The  above  approach  may  be  conceived  as  a  process  of  building 
up  simulator  scenes  by  adding  features  that  have  proven  to  be 
effective.  An  alternative  is  to  ask,  first,  which  features  of 
real-world  terrain  are  salient  to  pilots  during  low-level  flight. 
An  effort  is  currently  underway  to  analyze  photographic  imagery  of 
real— world  terrain  using  a  multidimensional  scaling  (MDS) 
technique.  Pilots  rate  the  visual  similarity  of  a  variety  of 
real-world  terrains  depicted  in  photographic  imagery  of  actual 
low-level  flight.  Ratings  are  submitted  to  an  MDS  analysis  which 
yields  as  output  a  spatial  mapping  of  terrains  such  that  terrains 
judged  to  be  similar  are  positioned  close  to  one  another  in  space 
whereas  dissimilar  terrains  are  positioned  farther  apart. 
Subsequent  examination  of  the  features  of  terrains  positioned  near 
one  another  in  space  provides  information  as  to  which  features  are 
salient  to  pilots. 

Results  thus  far  provide  consistent  evidence  that  pilots  are 
sensitive  to  two  essential  aspects  of  terrain:  1)  terrain  contour 
and  2)  object  size  and  spacing.  The  important  element  of  terrain 
contour  is  the  presence/ absence  of  hills  and  ridges  rather  than 
large  mountains  obstructing  the  horizon.  Such  features  are  not 
commonly  seen  in  simulator  scenes  and  have  not  been  previously 
evaluated.  Pilots  are  most  sensitive  to  tall  objects  with 
considerable  horizontal  extent,  that  is,  large  buildings  or  groups 
of  trees  clustered  closely  together  and  separated  by  open  spaces. 
Interestingly,  terrains  with  a  uniform  distribution  of  objects 
similar  to  those  used  in  simulator  investigations  were  positioned 
nearer  terrains  with  no  objects.  The  optimal  spatial  arrangement 
of  objects,  therefore,  appears  to  be  discontinuous. 

Multidimensional  scaling  analyses  have  been  performed  using 
subjects  with  a  variety  of  backgrounds  (including  non-pilots)  to 
determine  the  role  of  prior  experience  on  sensitivity  to  terrain 
features.  Surprisingly,  the  same  pattern  of  results  has  been 
obtained  with  each  group.  The  terrain  features  captured  by  this 
analysis,  therefore,  do  not  appear  to  reflect  information  learned 
during  actual  low-altitude  flight.  This  is  not  to  deny  that 
PerceP^ual  learning  occurs  as  pilots  become  more  proficient  at 
low-level  flight.  Rather,  it  suggests  that  learning  either  centers 
on  the  efficiency  with  which  cues  are  used  or,  possibly,  learning 
°f  idiosyncratic  cues  specific  to  terrains  over  which  pilots 
routinely  fly. 

Taken  together,  these  results  support  three  main  conclusions: 
1)  Three-dimensional  features  such  as  hills  and  tall  objects  are 
most  important;  2)  Although  high  object  density  is  important,  the 
optimal  spatial  distribution  of  objects  is  discontinuous  suggesting 
that  grouping  may  be  a  factor;  and  3)  Complex  texture  is  most 
useful  when  applied  to  large  surfaces  such  as  terrain  faces. 
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Scene  Related  Optical  information  Potentially  important 
for  Flight  Control 


Walter  W.  Johnson 
NASA  Ames  Research  Center 

c  .t^imul?or  vaUdation  and  edification  have,  in  general,  not  included  scene  content 
entena.  This  may,  m  part,  be  due  to  the  fact  that  fixed  wing  aircraft,  in  addition  to  beine 

iy^S?ment!f’,tend  10  °PCrale  at  altitudes  •»  enough  that  a  basic  horizon  line 
and  defined  groundplane  are  all  that  is  needed.  The  main  exception  to  this  is,  of  course 

during  landing  and  takeoff,  and  much  work  has  gone  into  creating  highly  realistic  visual’ 
databases  of  airports.  In  addition,  airports  tend  to  have  a  relatively  common  structure  so 
generalization  of  training  from  simulated  to  actual  airports  is  relatively  assured. 

On  the  other  hand  this  is  not  the  case  for  military  fixed  wing  NOE  and  contour  flights 
nor  for  much  civilian  and  military  helicopter  flight.  These  craft  often  operate  dose  to  the 
ground  where  they  are  controlled  almost  exclusively  on  the  basis  of  the  out-the- window 
scene.  Additionally,  helicopters  fly  near  the  ground  in  a  large  number  of  environments  (e  g 
emergency  medical  evacuations  at  accident  scenes,  rooftop  vertiports,  examining  transmission 
lines  and  pipelines),  not  only  in  the  highly  predictable  contexts  of  heliports  or  airports. 


Another  important  distinction  is  that,  in  the  majority  of  cases,  civil  training  simulators 
have  been  used  by  major  airlines  to  train  pilots  to  navigate  using  VORs  and  other  avionics- 
based  positioning  information.  Thus  navigational  information  is  not  being  obtained  from  the 
visual  scene.  For  the  case  of  helicopters,  and  much  light  aircraft  also,  navigation  is  often 
based  on  the  contents  of  the  visual  scene  as  sampled  through  the  aircraft  window.  Pilots  fly 
between  visual  landmarks,  follow  roads,  go  through  valleys  or  along  ridges,  etc. 

So  guidance  and  control  in  helicopter  and  military  simulators  are  more  strongly  impacted 
by  scene  content  than  has  been  the  case  for  most  previous  civil  simulators.  Given  this,  good 
criteria  for  scene  content  still  remains  to  be  determined.  One  question  that  could  be  asked  is 
if  there  is  any  good  evidence  that  suggests  scene  content  is  important  in  simulation 
performance.  The  answer  to  this  comes  from  both  flight  studies/flight  reports,  and  from  data 
obtained  in  simulator  studies. 


Perhaps  the  most  recent  evidence  concerning  the  importance  of  scene  content  to  flight 
performance  comes  from  difficulties  encountered  by  Army  helicopter  pilots  in  night  flights 
during  Operation  Desert  Storm.  Despite  the  aid  of  night  vision  goggles,  the  nighttime  desert 
presents  a  very  textureless  surface  to  pilots.  As  a  result  the  pilots  initially  encountered  much 
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Another  major  component  to  the 

where  no  usable  horizon  line  exiris),  where  pilots  often  °me 

«amining  how 

**■ ta 

|SSH=iH|S 

techniques  to  evaluate  which  types  of  optical  change  the  vehicle  operator  is  fttemJL  to 
regulate.  Below  some  selected  instances  of  this  work,  and  its  implications  for  spedfvine 
scene  content  criteria  for  helicopter  simulations,  is  listed.  mpUCaUons  tor 

Speed  Control 

r  hav^examined  the  Perception  and  control  of  forward  speed  in  a  number  of  studies 
In  these  studies  we  have  manipulated  edge  rate  (the  frequency  at  which  salient  scene 
e  ements  are  being  passed  by),  flow  rate  (the  mean  angular  speed  of  optical  elements)  and 
ground  speed  Previous  studies  have  shown  that  people  use  both  edge  and  flow  rate  ’ 
information  when  making  judgements  about  ground  speed,  but  that  edge  rate  tends  to 
dominate  (Owen  Wolpert,  &  Warren,  1983;  Larish  &  Flach,  1990).  These  studies  have 
been  done  in  level  flight  over  ground  textures  that  may  have  contained  insufficient  and 
possibly  even  conflicting  cues  to  observer  altitude.  This  presents  a  potential  problem  since 
edge  rate  vanes  with  both  ground  speed  and  ground  scene  element  density,  or 

edge  rate  =  (ground  speed)  *  (element  density) 

while  flow  rate  varies  with  both  ground  speed  and  altitude,  or 

flow  rate  =  (ground  speed)  /  (altitude) 

The  consequence  of  these  relationships  is  that  a  person  must  have  information  about  ground 
element  density  or  altitude  in  order  to  determine  ground  speed  from  edge  or  flow  rate  cues 
Without  good  altitude  cues  it  is  difficult  to  determine  if  changes  in  optical  density  are  due  to 
altitude  changes  or  to  ground  element  spacing,  and  thus  edge  rate  provides  ambiguous  ground 
speed  information.  Similarly,  without  good  altitude  cues  it  is  difficult  to  determine  if  a 
changing  flow  rate  is  due  to  a  ground  speed  change,  or  to  an  altitude  change. 

We  have  examined  the  ability  to  actively  control  ground  speed  while  manipulating  the 
presence/absence  of  changing  flow  rates,  edge  rates,  ground  speed,  and  both  with  and 

without  good  optical  information  about  altitude.  The  results  from  these  studies  have 

confirmed  previous  findings  showing  a  predisposition  to  use  edge  rate  information  to  judge 
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and  control  ground  speed,  but  have  also  shown  that  strong  altitude  cm*  will  .  .u 
SS  “*  “UPled  Wi,h  8r0Und  eleraent  chi“~  no, 

Altitude  Coutrol 

exaIf„XTl°Xrdo“neftl=trfhrra"d  "*  fo™*  **  ■»  been 

^  ^  bob*  -  omcJZZTof'Z^Z  s>“ 

feeler  (Johnson,  Tsang,  Bennett  &  Phauk  ?989)  ^  “  “  ,mp°rta”t 


Glideslope  and  Glideangle  Control 

Pv,?e  ^1SUaI!y  gu*ded  c°ntrol  of  descent  to  a  landing  surface  (helipad,  runway)  is  being 
anuned  m  a  number  of  studies.  Initial  research  on  the  control  of  descent  to  lLding  pads 

“dLw£ H^lfttaf  ^  Shh°W”  ^  rad°  effeCtS  Similar '°  th0Se  re»or,ed  by  Martens 

and  Lewis  (1982),  but  has  also  shown  that  form  ratio  is  insufficient  to  fully  account  for 
glideslope  acquisition.  Work  is  presently  being  conducted  to  try  to  isolate  the  optical  scene 
content  that  accounts  for  the  better  than  predicted  performance. 


The  implications  of  much  of  the  above  work  is  that  pilots  often  attend  to,  and  learn  to 
directly  regulate,  the  two-dimensional  cues  of  the  visible  scene.  This  is  in  contrast  to  the 
assumption  that  pilots  react  to  the  three-dimensional  geometry  which  they  have  recovered 
through  some  type  of  inverse  transformation.  Thus  learning  to  hover  in  the  presence  of 
towers  will  not  generate  the  same  skills  as  learning  to  hover  over  a  more  or  less  flat  terrain 
Similarly,  learning  to  land  a  helicopter  at  an  airport  with  a  clearly  visible  horizon  does  not 
necessarily  prepare  one  to  learn  to  land  a  helicopter  in  a  valley  where  there  is  no  visible 
horizon.  „  .  > 
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PERFORMANCE  EFFECTS  ON  PILOT  TASKS 
FLIGHT  IN  A  VIRTUAL  WORLD 


DURING 


Tom  Bennett,  Ph.D. 
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Introduction 


A  structured  visual  environment  (SVEl  mav  h*  u 

window-like  frame  or  by  large,  salicm ^ 

Such  an  environment  may  have  a  most  dramatic  influent  on  o^  perctpfi on 
md *0x71989)°  '  °ichganS  and  Brandt*  1978=  Howard,  1982;  Matin 


purely  psJchologicaf^tudTes' (Wkkin  a'nd^Asche!  194*;  Roll  ml  anT  Stop™ 
SS  Elworth,  ^69)  l°  ££  (S 


Levelness.  The  studies  examining  the  effects  of  SVE  on  performance 
have  explicitly  or  implicitly  categorized  the  concept  of  levelness  into  three 
different  perceptual  coordinate  systems:  gravity-,  optical-,  and  head- 

referenced  systems  (GRS,  ORS,  and  HRS).  Each  of  the  perceptual  coordinate 
systems  have  a  physical  analog  which  is  referenced  to  an  inertial,  euclidean, 
or  physiological  coordinate  system,  respectively. 


All  of  the  perceptual  coordinate  systems,  as  will  be  discussed,  may  be  in 
registration,  and  coincide  with  their  physical  analogs.  Such  an  instance  would 
provide  the  basis  for  a  conformal  perception  of  the  world.  Or,  under  certain 
naturally  occurring  conditions,  they  may  become  misaligned.  If  such  a 
situation  occurs,  the  perception  of  the  world  may  become  ambiguous,  with 
disorientation  as  a  potential,  inherent  result. 


Gravity-Referenced  System.  To  specify  the  location  of  a  target  with 
respect  to  the  GRS,  information  concerning  (a)  the  retinal  coordinates  of  an 
object,  (b)  the  orientation  of  the  eyes  in  the  head,  and  (c)  the  rotational 
position  of  the  gravitoception  system  with  respect  to  earth  gravity  must  be 

P131  *S’  or*entat*on  the  retina  must  be  specified  with  respect  to 
the  head;  and,  in  turn,  the  orientation  of  the  head  must  be  specified  with 
respect  to  the  earth.  If  a  person  is  standing  erect,  looking  at  the  horizon,  the 
orientation  of  the  eyes,  head,  and  earth  correspond. 

During  flight,  the  GRS  may  become  misaligned  with  respect  to  earth 
gravity.  (See  Figure  1.)  A  situation  like  this  may  occur  during  a  constant  rate 
turn,  alter  the  sensory  effects  of  acceleration  have  diminished  and  the  GRS 
becomes  referenced  to  the  force  vector  opposing  lift.  GRS  may  also  become 
misaligned  with  earth  gravity  during  forward  acceleration  (+GX).  Such  sudden 
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+  Gx  accelerations  will  result  in  the  oculogravic  perception  that  objects 
to  nse  above  their  true  location  (Cohen,  1977). 


appear 


The  force  vector  through  the  vertical  axis  of  an  observer  (+GZ)  is 
normally  coincident  with  earth's  gravity.  However,  during  a  turn,  +GZ  will 
shift  with  respect  to  the  earth’s  gravity  vector,  as  the  vestibular  system  adapts 
to  the  rotational  acceleration.  During  such  instances,  the  GRS  will  provide 
inaccurate  information  concerning  earth's  gravity,  and  a  pilot  will  perceive 
that  he  is  in  straight  and  level  flight,  though  he  is  still  in  a  bank. 


Optical-Referenced  System.  The  static  or  dynamic  perspective 
geometry  of  a  scene  specifies  euclidean  space.  Static  perspective  geometry  is 

typically  depicted  by  various  optical  gradients  such  as  size  and  density 

Dynamic  perspective  geometry  is  additionally  characterized  by  a  velocity 

gradient,  with  texture,  elements  closer  to  the  observer  having  the  greatest 

angular  velocity. 


Apart  from  the  scene  geometry,  an  observer’s  perceptual  interpretation 

of  the  scene  specifies  the  axes  of  the  ORS.  It  might  be  expected  that  the  ORS 

would  always  be  in  registration  with  the  GRS.  From  a  physical  perspective,  the 

optical  world  does  coincide  with  the  gravity  specified  inertial  coordinate 
system.  From  a  psychological  perspective,  however,  the  ORS,  a  perceptual 
system,  may  be  in  an  orientation  other  than  the  GRS,  another  perceptual 

system.  Such  a  situation  can  occur  naturally  during  night  flight,  when  ground 

lights  may  suggest  a  false  horizon.  See  Figure  2. 

Langewiesche  (1944)  suggested  that  glideslope  control  is  maintained  by 
regulating  the  distance  between  the  runway  aimpoint  and  the  true  horizon. 
This  distance  has  also  become  to  be  known  as  the  H-Distance  (Berry,  1970; 

Cutting,  1986).  However,  environmental  cues  may  provide  an  ambiguous 
interpretation  of  the  magnitude  of  the  H-Distance,  as  Kraft  (1978) 
demonstrated.  This  ambiguity  is  the  result  of  the  ORS  becoming  distorted  with 

respect  to  the  true  world,  euclidean  coordinate  system. 

Head-Referenced  System.  The  basis  for  specifying  the  coordinates 
of  the  HRS  are  the  vertical  and  horizontal  meridians  of  the  retina.  If  an 

observer's  eyes  are  normal  to  the  inertial  and  euclidean  vertical  axes,  the 
typical  perception  is  one  of  standing  erect.  Such  is  the  case  when  a  stationary 
observer  is  viewing  the  natural  horizon.  In  order  to  determine  the  location  of 
an  object  within  the  HRS,  extra-retinal  information  is  required,  such  as 
orientation  of  the  eyes  and  inertial  position  of  the  head. 

If  the  GRS  and  ORS  are  in  registration,  as  would  be  the  case  in  level, 
unaccelerated  flight,  the  problem  of  resolving  the  location  of  a  target  within 
the  HRS  is  essentially  trivial.  The  problem  exists  when  the  GRS  and  ORS  are  not 
m  registration.  As  was  suggested  earlier  (e.g.,  Cohen,  1977),  it  is  known  that 
both  the  location  of  a  target  within  the  HRS,  or  the  orientation  of  the  HRS  for 
that  matter,  may  be  independently  influenced  by  the  orientations  of  both  the 
GRS  and  ORS.  It  is, .  then,  when  the  GRS  and  ORS  become  misaligned  with  either 
each  other,  or  their  physical  analog,  that  an  observer  must  resolve  the 
ambiguity  to  which  of  these  two  reference  systems  the  HRS  must  coincide. 
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Problem  Statement 

com«uHeidd"”l“2da96T,j”“  TTfi  rm,  ic:e'°sKd  in  thc  i*®*. 

1968,  Sutherland  discussed  a  head-slaved  eraohlc^'lS'  1“*'°  c?mrol  s>,slem-  In 
later  demonstrated  by  Vickers  (197m  OneratL  1  based  virlual  world  that  was 
were  quickly  develop  ^ 

aeronautical  settings™  ollT"*  for'^hllme/01  *‘e*d‘1°?“n1'd  systems  in 

ssre..rtssa  TcMst-  ^  ^ 

;=ce4  tfrSSE- 5 

:rsrb*-  °f  ^d-«ormraLrd,s-  jsr^ss 

Early  on  in  the  development  of  head-mounted  virtual  ,>■„  i 

rr“'  wr«*  ^ef3t5£S 

°r  pmn*ing  accuracy  of  a  system  is  not  degraded  when  i/is  rolled  head 

AH  fid!  t  f0t  56  U.aCked‘  As  a  resuit*  current  displays,  such  as  that  used  in  the 
AH-64  helicopter  has  no  roll-compensation.  That  is,  when  a  pilot  views  the 
horizon  while  rolling  his  head,  the  horizon  follows  his  eye-plane  and  does  not 
remain  perpenchcular  to  gravity.  In  this  case,  the  display  is  said  to  be  image 
roll-stabilized;  or,  the  display  is  without  roll-compensation.  g 

rnmnr>r,PUsrP0SeS*  There  haS  been  no  rig°rpus  evaluation  of  whether  roll- 
compensation  is  a  necessary  requirement  for  the  design  of  head-mounted 

displays  that  are  used  for  tracking.  One  purpose  of  this  study  was  to  conduct  a 
ra  e  off  ana  ysis  of  the  benefits  of  image  roll-compensation,  thus 
contributing  to  the  design  criteria  for  head-mounted  displays. 

There  is  a  large  data  base  concerning  the  biases  produced  by  SVEs  on 
the  judgement  of  roll  (See  Howard  [1982]  for  reviews.).  On  the  other  hand, 
there  have  been  comparatively  few  studies  of  the  effects  of  SVEs  on  pitch 
ju  gements  (Cohen  and  Stoper,  1989).  Apparently,  all  of  the  studies  on  SVE 
have  used  discrete  tnal  paradigms,  during  which  both  the  observer  and  target 
were  stationary.  Apparently,  there  have  been  no  studies  of  the  affects  of 
relative  motion  in  SVEs  on  optical  bias  judgements.  A  second  purpose  of  this 

head  pursuU  ‘ff‘C‘S  °f  *"«**  'oU-PtdbiUzation on  fmoozh 


METHODS 

A  computer  generated,  perspective,  wire-frame  grid  was  displayed  to 
ve  observers  on  a  head-mounted,  one-inch  Sony  electronic  viewfinder 

~olh  fr°nt  ?f  016  observer’s  eyes-  Head  Position  was  monitored  by  means 
of  a  Polhemus  electromagnetic  head-tracker.  As  subjects  moved  their  heads 

one  7{T\^u*  h°Dtr0  thC  graph*es  of  lhc  virtuai  world.  The  sensation  was 
actually  being  in  and  looking  around  a  graphics  world.  The 
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instantaneous  FOV  was  20  x 
The  observers  were  "flown” 
different  altitudes.  Positioned 
Figure  3. 


18  degrees.  The  field-of-regard  was  360  degrees, 
over  the  grid  at  a  constant  airspeed  at  two 
on  the  surface  was  a  wire-frame  cube  See 


W3S  °ffsV°  left  or  right  of  the  direction  of  travel  by  two 

different  distances.  The  observer  was  instructed  to  track  the  target  with  a 
cross-hair  generated  on  the  middle  of  the  display.  The  combinations  of 
ahitudes  and  offsets  generated  a  set  of  optical  (angular)  velocities  at  which  the 

AfiSUr?  m°Ve  .re,a?.ve  10  tbe  observer.  Adjusted  root  mean  square  error 
(ARMSE)  between  the  dnect  line-of-sight  (LOS)  to  the  target  and  visual  LOS 
projection  to  the  ground  was  computed. 

The  graphical  roll  axis  was  frozen  during  half  of  the  trials,  in  a  random 
observers.  werc  D°t  informed  about  the  display  differences.  The 
eflect  of  this  operation  was  to  fix  the  horizon  line  in  the  FOV  of  the  display  so 
that  even  if  the  the  observer  rolled  his  head,  the  horizon  did  not  move. 
Observers  were  debriefed  after  the  trials  to  determine  if  they  observed 
anything  unusual  about  the  displays. 


RESULTS 

Figure  4  shows  the  angular  tracking  error  with  and  without  graphical 
roll-compensation  as  a  function  of  azimuth  from  the  simulated  vehicle  to  the 

target.  Altitude  or  offset  had  no  significant  effect  on  target  tracking  ARMSE, 
and  were  collapsed  within  roll  conditions. 

Tracking  error  significantly  increased  (p<0.001)  as  a  function  of 
azimuth  angle.  The  relevant  variable  here  is  the  optical  velocity  of  the  target. 

As  the  observer  approached  the  target,  the  angular  velocity  accelerated,  given 
a  constant  ground  speed.  Roll-compensation  was  not  associated  with  any 
significant  differences  in  ARMSE  (p>0.4). 

Furthermore,  the  observers  were  unable  to  identify  verbally  any 

differences  between  the  conditions  that  had  roll  stabilization,  and  those  that 

did  not.  This  was  true,  even  though  they  were  asked  specifically  about 
differences  in  the  displays. 


DISCUSSION 

The  results  of  this  study  are  consistent  with  an  earlier  evaluation  of 
target  tracking  performance  of  AH-64  helicopter  pilots  (Bennett,  et  al.,  1987). 
In  that  study,  target  tracking  errors  of  line  and  instructor  pilots  were 
approximately  15  milliradians  (for  normal  tracking  regimes),  which  is  near 
the  mechanical  tolerance  of  the  system.  Additionally,  the  tracking 
performance  of  the  pilots  was  equivalent  in  accuracy  to  that  of  non-pilots 
(using  comparable  optical  variables)  with  a  system  similar  to  the  one  used  in 
the  current  study. 

When  the  ORS  and  GRS  become  decoupled,  the  perceptual  system  must 
™b'Zm\y  forced  °n  ^  HRS  (Cohen  and  Stoper,  1989;  Matin  and 
fox,  lysy).  Using  discrete  trial  paradigms  and  static  positions  of  the  target  and 
observer,  it  appears  that  the  ORS  will  bias  judgements,  up  to  a  point.  As 
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discussed  in  the  introduction,  during  flight  the  OR<?  anH  roc  •„  . 
generate  orientation  illusions.  In  Italic  setting^  (S« v  deC°uple  Md 
judgements,  or  how  the  HRS  will  resnlv*  tk*  .abov.e.),  bias  of  optical 

magnitude  of  the  disc^y  teLntl' <£l  Sf©  -  *• 

optical  system  diminishes  with  larger  differences  from  Th  mfluence  of  thc 
During  smooth  pursuit  head-tmekhtg.  the  ORS  tSta£ the ^!”V“y  SySltm " 

Play  little^hnpMtanc^in^the^ctm^rol'^MieLM^V1*18'  °pdcal  '°"  v>riabl“ 

conclusion  is  Liter  su£o£d  by  £  L,  ™  of  P<f°nn“‘Le- 

verbalize  the  differences  between  the  roll  ^  one  of  the  subjects  could 

displays.  between  the  roll  compensated  and  non-compensated 
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the  effects  of  laser  system.  T*. effects  *tUdyin« 

i.  one  "of  the  priory'  V  °f  1“«  “«W 

?  ns“  re“fa“dn““  °£  the  -^4  ££s  ;fuhLlabs 

The  laser  program  may  be  divided  into  5  major  areas:  operational 
upport,  optical  countermeasures,  optical  counter-counter  measures  health 
and  safety,  mdio.l  diagnosis  and  treat™* .  There  is  sLT""!^ 
etween  these  areas  and  they  are  not  clearly  separable. 

tho  °Perational  support  is  directed  toward  solving  immediate  problems  of 

™de  :r:ilSratt°nal  UnitS  ln  th*  Air  F°— •  harard  asae,a™°ts^e 
made  of  military  laser  systems.  The  eyewear  to  protect  against  laser 

hazards  is  quality  tested  and  evaluated.  We  provide  consumptions  and 

make  recommendations  concerning  the  use  of  laser  systems  and  laser  eye 

Support 1in’thiCf;Ldentf  r  incidents  involving  lasers  are  investigated, 
provided  S6r  S3fety  and  awareness  instruction  is  also 

fi^hhPP1  counterroeasures  is  concerned  with  quantifying  glare, 

result incPerfn  laaer  lesions  from  Animal  to  hemorrhagic  and  the 
tPP  h  Perforlnance  decrements.  Simulation  and  image  processing  are  two 
tools  which  are  used  in  this  research  in  this  area  to  gain  an 
understanding  of  these  issues . 


protection^ rom  er‘C°Unt^rroeasures  Program  primarily  deals  with  eye 

t „ Cf  lasers-  Specific  visors  and  other  eye  protection  are 
tested  to  determine  their  optical  density  for  specific  wavelengths  other 

of  the  properties,  damage  thresholds,  comfort,  and  the  possibS  effects 
of  the  visors  themselves  on  vision.  erxects 


Health  and  safety  is  a  fourth  main  area.  A  major  program  is 
developing  to  assess  the  damage  mechanisms  and  thresholds ?of  ultrashort 
(down  to  femtosecond)  laser  systems.  Currently,  there  is  not  safeP 
standard  for  short  pulses  of  1  nanosecond  and  less  The  PP 
standard  working  groups  are  supported  laSer 
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A  fxnal  area,  medical  diagnosis  and  treatment-  <  ■ 

IT-*  °f  th*  “  ^  ISUXZrZL* 

of  laser  weapons  as  an  adjunct  or  stand  alone  air  defense  system  in  a 
force  on  force  engagement.  Information  on  opportunities  of  engagement 
(co-field-of-view)  between  aircraft  and  laser  weapons  was  gathlrld. 

Glare,  scotoma  effects,  and  "eye  defeat"  were  simulated  and  the  reactions 
of  aircrews  with  and  without  eye  protection  were  recorded.  Research  is 
ongoing  in  our  laboratory  on  many  of  the  issues  involved  in  this  exercise. 
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Grating  Acuity  following  Laser- 
Monkeys  and  Simulated  Lesions 


'SSLS?'?1  R6tl“11  ‘•■ion,  in 

(Artificial  Scotomas)  in  Human  Subjects 


James  w.  Rhodes,  Ph.D 
405  W.  Nakoraa, 


KRUG  Life  Sciences  Inc 
San  Antonio,  TX  78216 


and 

Maj  Leon  McLin,  Armstrong  Laboratory/OEDL, 
Brooks  AFB,  TX  78235 


lasers^ere^introduced^as^^aboratory^iastruieMit^^ok*^911  t0  °CCUr  S°°n  after 

reported  injuries  was  by  Rathkev  (iggsi  ™  J  ®  of  the  earJ-iest 
since  continued  to  climb  with  the  Drolif-  ^  nu®ber  of  such  incidents  has 
'»  lobooatory  vo.h.r,,  ™  °J  fohnolojy.  «ide 

military  personnel  who  work  in  operational  greatest  risk  has  been 

and  target  designators  are  in  use.  in  ever-T^*0™******  Where  ran^e  finders 
military  laser  retinal  injury,  there  has  be*  ocumented  case  of  laboratory  and 
vision.  m  some  cases,  the  Effect  was  ?  aSSOciated  disturbance  of 

2,  Boldrey  et  al.,  198I)  but  there  qUi°kly  ^solved  (e.g..  Case 

profound  loss  of  vision  and  only  partial  visual  nUlnber  of  ^stances  of 

Zuidema,  1975).  sual  recovery  (e.g.,  Henkes  & 

Tissue  damage  from  ocular  laser 

upon  the  parameter  values  of  the  laser  In  a  vary  considerably,  depending 
Wolfe  (1986)  divided  tissue  d^ge  level  into  fZIZ  °r  la8®r  aCCident  Cases' 

sc  Jsa  selss.?-  ~  r  r  - 

the  retinal  fovea  (i.e.,  an  area  5  dea  injuries  occurring  within 

the  foveola),  or  those  occurring  outside  t^f©^^  £o  f^®*'  °entered  on 
the  visual  deficit,  as  assessed  ,  .  a*  To  a  first  approximation, 

and  was  worse  for  foveal  as  opposed  acuxty'  increased  with  injury  grade, 

extent  of  visual  acuity  loss  varied  sion^?^??6*1'  dam*ge'  However,  the 

y  83  varied  significantly  within  a  given  damage  level. 

,=ie«i^“fc^a“o°CUttL1th  <,OCid“‘t  °“*  reP°rt*  “  *  of 

injury.  That  i.,  the 

they  were  examined,  make  comparison  an™..  th®  A“Jurxef'  and  when  and  how 
hand,  laboratory  studies  of  laser  in-i  h  CaSea  Probleinatic.  on  the  other 
the  relevant  parameters  Insofar  a J***  5h®  advanta9e  of  control  over 
reports  may  therefore  function  a.  ®y  ®V®  he«n  identified.  Accident  case 
laboratory  function  as  a  source  of  hypotheses  to  be  tested  in  the 
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Our  laboratory  has  been  interested  in  the  quantitative  studv  of 
effeot  of  Grade  IV  hemorrhagic  lesions  on  visual  acuity.  Retinal  injuries  of 
this  level  represent  a  worst-case  condition  for  performance  of  a  task 
requiring  spatial  vision.  Wolfe  (1986)  and  others  have  shown  that  at  this 
damage  level,  initial  acuity  may  be  quite  poor  (some  accident  victims  have 
reported  temporary,  complete  blindness  in  the  injured  eye) ,  but  a  remarkable 
degree  of  recovery  may  also  be  achieved.  Both  the  time  course  and  extent  of 
recovery  can  differ  considerably  across  individual  cases  (e.g..  Case  1, 
Manning  et  al.,  1986  vs  Lang  et  al.,  1985).  By  studying  this  type  of  injury 
in  the  laboratory  we  hoped  to  learn  more  about  the  near-term  effects  as  well 
as  the  time  course  of  recovery.  What  will  be  reported  here  is  progress  of 
ongoing  work. 


HEMORRHAGIC  LESION  STUDIES 

Two  rhesus  monkeys  were  used  as  subjects.  The  animals  involved  in  this 
study  were  procured,  maintained,  and  used  in  accordance  with  the  Animal 
Welfare  Act  and  the  "Guide  for  the  Care  and  Use  of  Laboratory  Animals" 
prepared  by  the  Institute  of  Laboratory  Animal  Resources  -  National  Research 
Council.  They  were  operantly  trained  with  positive  reinforcement  to  push  a 
response  lever  when  an  acuity  target  was  briefly  (0.5  s)  presented.  The  task 
was  structured  into  a  series  of  discrete  trials,  and  one  target  was  presented 
per  trial.  The  target  was  a  square-wave  luminance  grating  at  90%  contrast  and 
30  cd/m  space  averaged  luminance.  Grating  spatial  frequency  was  varied  in 
twelve  steps  from  0.4  to  26  cycles  per  degree  (cpd) .  The  stimulus  field 
subtended  9.3  deg  of  visual  angle  at  the  viewing  distance  of  158.5  cm.  When 
the  grating  was  not  present,  the  stimulus  field  was  homogeneous  and  had  the 
same  average  luminance  as  the  grating. 

Visual  acuity  was  determined  by  a  simple  up-down  psychophysical  staircase 
procedure.  Each  correct  response  increased  the  spatial  frequency  by  one  step, 
whereas  an  incorrect  response  decreased  spatial  frequency  by  an  equal  amount. 
The  staircase  procedure  increased  the  spatial  frequency  until  the  subject's 
resolution  limit  was  reached;  at  that  point,  the  spatial  frequency  tended  to 
oscillate  about  the  subject's  detection  threshold  across  trials.  Each 
transition  from  detection  to  non-detection,  or  vice  versa,  marked  an  acuity 
estimate.  Acuity  was  the  mean  of  the  two  spatial  frequencies  associated  with 
adjacent  trials  in  which  a  correct  response  was  given  on  one,  and  an  incorrect 
response  was  given  on  the  other. 

Laser  exposures  were  made  by  a  Q-switched  Nd: glass  laser  with  a  pulse 
duration  of  20  ns  and  1060-nm  wavelength.  One  exposure  was  made  per  subject. 
The  laser  exposure  took  place  while  the  subject  was  engaged  in  the  visual 
acuity  task.  A  dual  Purkinje  image  (DPI)  eye  tracker,  equipped  with  a  device 
to  stabilize  the  laser  beam  on  the  subject's  retina  (i.e.,  a  Fundus 
Illumination  and  Measurement  Instrument  or  FIMI),  was  used  to  guide  the  laser 
exposure  onto  the  retinal  target.  Immediately  after  the  exposure,  the  spatial 
frequency  was  set  to  the  midrange  level,  and  the  staircase  procedure  was  then 
used  to  follow  the  subject's  acuity,  just  as  it  had  in  the  pre-exposure 
baseline.  At  the  end  of  the  exposure  session,  the  subject  was  anesthetized 
for  fundus  photography  to  document  the  retinal  injury.  The  subject  was  able 
to  resume  testing  on  the  following  day. 
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ARTIFICIAL  SCOTOMA  STUDIES 


Except  in  rare  cases  in  which  an  eye  is  to  be  removed  for  medical 
reasons,  experimental  induction  of  laser  retinal  lesions  cannot^  Informed 

retinal^e  .  there  are  means  of  safely  simulating  aspect^  of 

retinal  lesions  an  human  subjects.  The  voluntary  informed  consent  of  the 
subjects  used  in  this  study  was  obtained  in  accordance  with  AFR  169-3  our 

a  tr*cker  sy*te" « 

visual  field  obscurations,  which  are  likely  to  be  one  of  the  most  salient 
feature,  injury.  Th„.  Irtifici.i  .^^re  *.«««  on 

the  subject' s  fovea  to  simulate  foveal  centered  lesions.  StLilization  of  ^ 

^aTac^i™11^  ^  the  DPI  ^  traCk^  “  the  -*•*  performed 


Two  visual  acuity  tasks  were  examined.  One  was  grating  detection 
structured  identically  to  that  used  for  the  rhesus  monkey  subjects.  Due  to 
pparatus  constraints,  the  mean  luminance  level  was  at  5  cd/m^  rather  than  30 

ttit “I,  Te  ViS“al  £ieW  ““  al’°  Slightly  smaller  (S  ».  9.3  de”  tSe 

patial  frequency  range  slightly  expanded  (0.5  to  32  cpd  vs.  0.4  to  26  cpd) 

thH,0:  in^2otaSk'  n°.t  U3ed  ln  the  “1“1  ...  identification  of 

the  gap  m  Landolt  ring  targets.  Subjects  moved  a  joystick  to  indicate  the 

bothCta!v  °  ?aP  relative  to  the  12'  3'  9  o'clock  positions.  For 

both  tasks,  visual  acuity  was  measured  with  an  artificial  scotoma  present  and 

with  scotomas  ranging  from  1  to  6  deg  of  visual  angle  in  size. 

RESULTS 


The  data  to  be  reported  below  reflect  work  in  progress.  No  statistical 
analyses  have  been  performed  to  verify  that  differences  in  acuity  as  a 

level 10n  treatment  conditions  reach  statistical  significance  at  a  selected 


20/1 f  ?  !PPe  t0  the  l0WeSt  TOasurable  levels  (i.e.,  0.4  cpd  or 
air  1,mnedtate;Ly  after  the  laser  exposure  for  both  rhesus  monkey 

ISIS'  °f  3  ***  in  the  case  of  subject  609Z  and  of  49  s  for 

subject  454D,  measurable  recovery  of  visual  acuity  began.  Subject  60 9Z 

reached  an  average  acuity  of  14.9  cpd  (20/40  Snellen  acuity)  on  the  day  of 

rrr^r/1-  vThe  av®rage  acuity  for  subject  454D  on  exposure  day 
was  d.o  cpd  (20/71)  (see  Figure  2).  1 

The  acuity  level  for  subject  60 9Z  remained  near  15  cpd  for  13  days  post- 

SrtrI;tTnreUPOn  i%rOSe  t0  21  CPd  (20/29>  and  a^d  Sose  to  tSPlES 
testing  was  completed  37  days  post-exposure  (see  Figure  3) .  Average 
pre-exposure  acuity  was  22.7  cpd  (20/26).  Average 

*™ACUiny  f°r  SUbjeCt  454D  fUrth6r  declined  du*ing  the  first  two  post¬ 
exposure  days  to  an  average  of  5.8  cpd  (20/103),  and  then  gradually^mproved 
n  average  of  16.6  cpd  (20/36)  by  post-exposure  day  7  (see  Figure  4) 

dinLr111^  rem3ined  Cl°Se  t0  16  Cpd  ^  the  completion  of  £2 ing  37 
durina  SSXPOSUre’  7"**  *  trend  tOW3rd  *»rthor  improvement 

18  c pi  ^O/SS^S/Lf^r-  11  inaWh±Ch  average  acuity  was  between  17.3  and 
(20/30).  ig"  4  ’  AveraSe  Pre-exposure  acuity  was  19.7  cpd 
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Preliminary  findings  for  grating  acuity  in  the  presence  n-F  »■*■**•  ■  i 
scotomas  indicate  acuity  reductions  comparable  to  those  found  witf^tinal 
lesions.  For  example,  one  subject  showed  an  average  acuity  of  12  cpd  (20/50) 
with  a  6  deg  scotoma  and  19  cpd  (20/32)  with  a  3  deg  scotoma.  These  results 
bracket  the  grating  acuity  of  both  lesion  subjects  except  during  the  early 
post-exposure  period.  Additional  data  on  grating  and  lldolt  acuUy  In  2. 
presence  of  artificial  scotomas  is  anticipated. 
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Figure  2 

VISUAL  ACUITY  —  SUBJECT  =  454D 
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introduction 

spatialSSsi™yIsC^ooSeaebv°dnPhy?i°1°9iCal  evide“e  =v39est,  that  Wn 

f=a  i-a  r;- r;; 

filters  are^eighted^v^h^h131  frequencies  and  UP  to  12  orientations.  These 
liters  are  weighted  by  the  human  spatial  contrast  sensitivity  function 

Sy.°£  tha  “  —  m  accordance 

=h.„„eLrrvw°“:hr:?:r“,n:"it^:ttoon;nyeat:™:t1  :r*r  :f 

the  human  visual  system  processes  snat-i*i  a.-  w  and  models  of  how 

psychophysical  data  which  usS  relaS^li  dnfo^tion  have  been  derived  from 

one  to  three  spatial  frequencies  with  or  wiuSt  <C°nS;Lf ting  ?f  only 

targets.  Whether  these  models  hold  for  Jta  coLe^J  orientations)  as 

^L!!^riagacn:ZiTri““taf  — ^ ,cr^; 
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EXPEROSNTAL  GOALS  AND  BMTflB»rT 


There  are  two  primary  goals  for  this  project.  The  first  aoal  is  to 
determine  if  the  Wilson  (1991)  model  can  be  used  to  filter  a  complex  target 
and  adequately  predict,  from  the  relative  magnitudes  of  the  filters'  9 
responses,  the  spatial  information  required  to  detect  a  target  of  militarv 
significance  at  threshold.  The  second  goal  is  to  determine  if  the  infection 
from  a  very  small  number  (i.e.,  3  out  of  16,000)  of  the  Wilson  model  filters 
is  adequate  to  signal  threshold  target  detection.  Our  strategy  was  to 
determine  if  statistically  equivalent  detection  thresholds  could  be  obtained 
for  a  B-l  bomber  target  (Airplane  target)  and  a  second  target  produced  from 
the  visual  outputs  of  three  of  the  Wilson  model  filters  with  the  highest 
response  magnitudes  after  filtering  the  B-l  bomber  target  (Filter  target) 


Four  experiments  were  performed  to  test  our  hypothesis.  In  Experiment 
1,  target  contrast  was  systematically  varied,  which,  theoretically,  should 
minimize  the  number  of  activated  spatial-filtering  channels  at  threshold.  In 
Experiments  2  and  3,  static  and  dynamic  Gaussian  "white"  noise  was 
superimposed  upon  the  targets  at  one  of  two  fixed  root-mean  square  (rms) 
levels,  and  target  contrast  was  systematically  varied  to  measure  threshold. 

By  definition,  "white"  noise  should  equally  activate  all  spatial-filtering 
channels  but  only  those  most  sensitive  to  the  target  should  have  enough  signal 
strength  to  produce  a  detectable  signal-to-noise  ratio  (SNR) .  The  two  noise 
rms  levels  should  affect  detection  thresholds  (i.e.,  higher  noise  rms  levels 
should  produce  higher  thresholds)  but  not  the  equivalence  between  the  Airplane 
target  and  Filter  target  thresholds.  Dynamic  noise  experiments  can  provide  us 
with  some  insight  as  to  the  temporal  characteristics  of  the  filters  used  and 
their  compatibility  to  ideal  detector  properties.  Experiment  4  was  designed 
to  further  validate  the  results  of  Experiment  1.  Experiments  1  and  4  were 
identical  except  for  the  filters  used  to  construct  the  Filter  target.  In 
Experiment  4,  the  Filter  target  was  generated  using  the  outputs  of  three 
filters  (300-302)  whose  response  magnitudes  were  one-half  the  amounts  of  the 
three  greatest  responding  filters  (1-3) .  If  our  theoretical  assumption  for 
Experiment  1  is  correct,  the  Filter  target  used  in  Experiment  4  should  produce 
detection  thresholds  which  are  significantly  different  (and  higher)  than  those 
measured  for  the  Airplane  target . 


materials  and  methods 


Subjects : 

Six  observers  (male  and  female),  ranging  in  age  from  28-41  years,  served 
as  subjects  in  each  of  these  experiments.  The  voluntary  informed  consent  of 
the  subjects  used  in  this  research  was  obtained  in  accordance  with  AFR  169-3. 
The  subject  population  for  Experiment  4  differed  slightly  from  that  of  the 
other  experiments.  All  subjects  had  visual  acuities  correctable  to  20/20, 
normal  fundus  examinations,  and  normal  color  vision. 
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Target  and  Noise  Production; 


The  DOG  filters  of  Wilson's  (1991 » 

processing  system  (IPS)  consisting  of  a  Pr<>graiamed  on  an  image- 

framebuffer  and  PV-WAVE  software  (PracL^  v-  computer  with  a  Parallax 
filters  were  installed  to  represent  the  six  ^!^als) *  Approximately  16,000 
0.5*  X  0.5*  area  of  the  foveola  at  the  Nvouist  <rerent  filter  types  sailing  a 
photograph  of  a  B-l  bomber  was  digit  ised^!^  f***°*ney  (Williams,  1985)  .  a 
CRT  monitor  as  a  0  4«  X  1  39 •  °"  S*  IPS  and  displayed  on  a  color 

"white"  (x  -  0.28,  y  <5°  ^ 

was  plotted  and  analyzed.  The  absolute  v“Ss  it tSf 

magnitudes  were  then  calculated  and  .  f  °f  the  filters  response 

the  greatest  response  magnitude.  The  th lie  filt^^Tt^^io^1^'*  *** 
magnitude  (or  the  three  with  one-half  of  «->«>  „  * 5®  lth  th®  hi9hest  response 

recombined  to  produce  the  second  Filter  te^aeus*.*’1  “9nItude»  “*r« 

.no  d^u^n.”ia‘5rr2s«  TxzrzsjTi  ”s  9e»— *  -*■»  — 

This  1  59*  X  1.79-  inset  »as  superimposed  upon".^^^  at  either°l5°or235 

.“^"SL-Tt  itxh  :i”ey:  ~ 

subsequent  frames  as 


Procedure : 


p  n  *  tw°-alternative  forced  choice  procedure  was  used  for  all  experiments 
Following  3  min  of  light  adaptation  to  the  background,  an  adaptive^taircase 
procedure  (Harvey's  (1986)  ML-TEST  procedure)  presented  the  targets  randomly 

two  sub  r?  i  raSt  values-  The  sub3«ct's  task  was  to  determine  in  which  of 
two  sub-trials  a  target  (either  target)  appeared.  Six  staircases  (3  per 

target  type)  were  run  within  an  experimental  session  and  three  experimental 
sessions  were  performed  by  each  of  the  six  subjects.  ML-TEST  ended  the 
experiment  when  a  95%  confidence  interval  had  been  obtained  about  each 
staircase  s  threshold.  Thresholds  corresponded  to  the  Weber  contrast 

^^orree^rLnnn  4>  “  1'fdnance-ba  1 8ed  «»  (Experiments  2  and  3)  to  which  a 
0^%  correct  response  was  obtained. 

effectrof^he  St8tistical  tests  «*•  performed  to  determine  the 

!• ,fa^tors  of  target  type,  subject,  experimental  session,  and 
variable^  3^10?3  U?dependent  variables)  on  detection  thresholds  (dependent 
analyzed  '  Experiment  4,  the  main  factor  of  experimental  session  was  not 
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RESULTS 


Results  from  Experiments  1  and  2  indicate  the  Airplane  and  Filter 
(filters  1-3)  targets  yield  statistically  equivalent  detection  thresholds. 

None  of  the  three  main  factors  had  a  significant  influence  on  detection 
thresholds  under  contrast  reduction  or  static  noise  superinposition .  This 
finding  was  true  for  both  noise  nns  levels  used  in  Experiment  2.  Results  from 
Experiment  3  indicate  the  two  targets  yield  statistically  different  thresholds 
using  both  noise  nns  levels .  The  main  factor  of  target  type  was  found  to 
significantly  influence  the  detection  thresholds  (p  <  0.05).  Post-hoc  sign 
test  analysis  indicated  that  Airplane  target  thresholds  were  significantly 
larger  than  Filter  target  thresholds  <p  <  0.05)  for  both  dynamic  noise  rms 
levels.  These  data  indicate  that  the  30  Hz  temporal  integration  of  the  noise 
enhanced  Filter  target  detection  more  so  than  Airplane  target  detection. 
Furthermore,  post-hoc  analysis  indicated  that  although  always  lower,  dynamic 
noise  thresholds  could  not  be  predicted  from  static  noise  thresholds  using  the 
ideal  detector  theory  (dynamic  noise  thresholds  «*  static  noise  thresholds  X 
1/sq.  root  of  30) .  Results  from  Experiment  4  indicate  that  the  Airplane 
target  and  the  Filter  target  (filters  300-302)  also  produced  significantly 
different  thresholds.  The  main  factor  of  target  type  had  a  significant  effect 
on  detection  thresholds  (p  <  0.05).  For  all  but  one  subject.  Filter  target 
thresholds  were  higher  than  Airplane  target  thresholds. 


DISCUSSION  AND  CONCLUSIONS 

Our  data  indicate  that  the  Wilson  (1991)  model  can  be  used  to  predict 
the  spatial  information  (spatial  frequency,  orientation,  spatial  location) 
required  to  detect  static  complex  targets  on  static  backgrounds.  For  static 
targets,  it  appears  that  the  spatial  information  from  a  very  small  number  of 
filters  with  the  highest  response  magnitudes  to  the  Airplane  image  is 
sufficient  to  signal  threshold  detection.  Introducing  temporal 
characteristics  to  the  background  removes  the  model's  prediction  capability 
under  our  experimental  conditions.  This  result  does  not  surprise  us  because 
the  Wilson  (1991)  model  is  a  spatial  vision  model  not  a  spatiotemporal  vision 
model.  However,  the  extracted  spatial  information  contained  within  the  Filter 
target  appears  to  be  easier  to  detect  at  threshold  under  dynamic  background 
conditions  than  is  the  actual  Airplane  target .  Further  experimentation  is 
required  to  determine  the  applicability  of  using  the  model  to  enhance  target 
detection  on  dynamic  backgrounds.  We  also  do  not  know  whether  target 
discrimination  is  enhanced  by  this  type  of  target  compression.  However,  use 
of  the  Wilson  (1991)  model  for  applications  in  static  scenes  or  environments 
little  to  no  significant  temporal  characteristics  is  very  encouraging. 

We  have  several  lines  of  investigation  to  pursue  to  continue  to  verify 
and  expand  upon  the  Wilson  model.  We  are  currently  testing  the  model  using  a 
similar  paradigm  as  that  described  above  to  determine  if  our  results  are  true 
for  static  target  discrimination  as  well  as  detection.  Experiments  to 
determine  whether  similar  flashblindness  recovery  times  can  be  obtained  for 
the  Airplane  and  Filter  targets  have  also  been  planned.  In  addition,  we  would 
like  to  experimentally  determine  the  temporal  bandwidths  of  the  different 


56 


!^ia\freqU€nCy'tUned  £ilter  types  in  attempt  to  expand  the  model's 
applications  into  the  spatiotemporal  domain. 
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Target  Acquisition  Simulation 


using  Real-world  Targets  and  Backgrounds 


William  Kosnik 
KRUG  Life  Sciences  Inc. 
PO  Box  790644 
San  Antonio,  TX  78279-0644 


INTRODUCTION 

Visual  target  acquisition  is  a  critical  congionent  of  air-to-air 
engagements .  Loss  of  visual  contact  with  the  adversary,  even  for  a  few 
seconds,  can  seriously  jeopardize  the  safety  of  the  aircrew.  Lasers  have  the 
capability  to  cause  transient  or  prolonged  disruption  of  visual  processing. 

The  purpose  of  this  study  was  to  estimate  the  effects  of  temporary  visual  loss 
from  a  laser  exposure  on  target  acquisition  performance. 

The  target  acquisition  task  involves  detecting  a  target  within  the  search 
scene.  Often,  a  target  must  be  detected  against  a  natural  background  that  may 
have  a  complex  luminance  distribution.  In  cases  in  which  the  background  is 
sufficiently  complex  to  impose  significant  structure  or  distractors  on  the 
search  scene,  the  task  changes  from  detection  to  the  more  difficult  task  of 
recognition.  Thus,  background  features  will  have  a  significant  influence  on 
target  acquisition  performance. 


Another  goal  of  this  project  was  to  evaluate  the  effect  of  target  contrast 
and  scene  complexity  on  acquisition  performance.  This  goal  presents  a 
technical  challenge  because  target  parameters  must  be  held  constant  from 
background  to  background.  While  this  requirement  is  not  difficult  to  achieve 
for  parameters  such  as  size,  shape,  and  orientation,  controlling  contrast  is 
difficult  because  target  contrast  is  intimately  linked  to  the  background  on 
which  it  appears .  The  problem  we  faced  was  how  to  control  target  contrast  in 
the  presence  of  variable  backgrounds. 


We  developed  a  technique  that  maintains  target’  contrast  at  a  constant 
level  despite  a  changing  background.  Our  approach  capitalized  on  a  common 
method  for  defining  the  luminance  variation  in  a  scene,  the  root-mean  square 
(RMS)  contrast.  The  technique  involves  varying  the  target  luminance  to 
achieve  the  desired  contrast,  while  leaving  the  local  background  intact.  By 
varying  only  the  target  luminance,  contrast  can  be  controlled  independently  of 
the  background. 

Because  our  technique  controls  contrast  on  virtually  any  background,  we 
were  able  to  directly  compare  search  performance  for  the  same  target  on 
different  backgrounds.  At  issue  was  whether  search  data  for  targets  on 
uniform  backgrounds  (detection)  are  predictive  of  performance  for  the  same 
targets  on  other,  more  complex  backgrounds  (recognition) . 
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e£fe=tsUn\a=^„Sd1o^niVor»n"Lb*««ch,^llt0  9l0b*Uy  ••«■•  the 
structureless,  uniform  background,  a  natural  +*' ■  Th®  back9*°unds  were  a 
natural  terrain  in  motion.  This  last  bLkgro^d^11  bf^ground'  *  similar 
terrain  shot  from  a  low-flying  aircraft  in  J^-T?3  Vide°  f°°tage  of  natural 
varied  within  each  background  The  effects  of ^  target  COntra«  was 

complexity,  and  target  contrast  on  target  ac^i^r-*  ejtposure'  background 
studied.  target  acquisition  performance  were 

METHOD 

Twenty-four  male  subjects  participated  in 
background  condition.  Subjects  had  n *  *  experiment,  eight  in  each 
ophthalmological  exam.  All  subjects  were  J*Si°n  as  tested  h*  a  complete 
“•  voluntary,  fully  informeTIo^t "*  ”atur*  °f  th«  ««■ 
was  obtained  as  required  by  APR  169-3  lects  used  in  this  research 

of  vib:a  °£  “ni£or"  wn““  -**-«».  o.6» 

the  local  background  T  °£  th<!  Pl« 

achieve  contrasts  of  .15,  .25,  .35,  and  .45  r^s  *  wa3  adjusted  to 

targlr^t^JsTkin0:  ^  ^ 

the  contrast  is  high;  when  the  tamer  i  .  ry  °W  tar^et  luminance  values, 
the  background,  contrast  reaches  a  mini^^Then^target*  T  lumfnance  of 
aqain  as  the  target  luminance  exceeds  the 

•ni,uM .....  3  . . ■■■ 

were  processed  with  Precision^ilu^s  P^STsoftwIfe^  ***  baCkgr°und  images 
wonitorCplaced^66  ™a.a^  T“‘  °£  * 

sssr  — ■*-  “ith  **■  *£**£22  i»  :*£ d» e 

the  t.:„t.ThL,“hr 2*ss*  s  rzrtszr1  ”hen  ha *— 

the  inage,  in  randon  locations  One  If  the  £o™  f  ,b"“”  *PP«r«d  on 
the  target.  The  observer  picked  ~I  ^  II  I  *“  ln  th«  »“»  location  as 
recorded  as  right  oI  «"gP  ”  °£  the  b°’"”'  *nd  hia  «»*»■>»*  was 


The  Util"  _"lth  "oilorn  and  terrain  backgrounds  had  tine  limits  of  90  s 

not  ^\hTt,t^etd^iC„^“t2nditi0n  ~  30  «■  “  ^  did 

response  tine  JTJZZVZ  ~  1  a"d 

coi»^di«aiitftta1iLi.1"i«e*psiri1nrtiad'  the<ioo-,“  fi“»  ••• 

beamsplitting  pellicle  It  was  seen  i  u  was  superimposed  on  the  image  by  a 

diameter.  lie  516-™  iighl  ill. h  M""eUian  view  and  was  10°  in 

nm  light  flash  wa,  generated  from  a  Spectr.-Physics  168B 
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argon  laser.  Flash  energy  was  1.47  mJ  which  corresponded  to  a  retinal 
illuminance  of  7.4  log  td-s. 

One  experimental  session  consisted  of  12  flash  and  12  no-flash  trials, 
presented  in  random  order.  The  four  contrast  levels  were  also  randomly 
presented  within  a  session,  but  were  equally  distributed  across  the  flash  and 
no-f^as^  trials.  A  total  of  96  trials  was  collected  on  each  observer . 

The  data  were  analyzed  in  a  Background  (3)  X  Contrast  (4)  X  Flash  (2)  X 
Zone  (3)  mixed  factorial  design.  The  Background  variable  was  a  between-groups 
factor  and  all  other  variables  were  repeated  factors.  We  transformed  the  data 
into  logarithms  to  normalize  the  search-time  distributions. 

RESULTS 

The  ANOVA  revealed  two  significant  three-way  interactions.  The  Background 
X  Contrast  X  Flash  interaction  was  significant  F(6,63)  -  18.76,  £  <  0.0001, 
and  the  Background  X  Contrast  X  Zone  effect,  F (12, 126)  -  2.45,  £  <  0.01,  was 
also  significant. 

The  first  interaction  is  shown  in  Figure  4.  As  expected,  the  laser  flash 
caused  an  elevation  in  search  time.  The  increase  in  search  time  was  anywhere 
between  4-10  times  the  baseline  level.  Furthermore,  regardless  of  the  flash 
condition,  search  times  were  longest  for  the  natural  terrain  background, 
followed  by  the  dynamic,  and  the  uniform  backgrounds.  However,  the  amount 
search  time  was  elevated  depended  on  the  type  of  background  and  target 
contrast.  In  general,  the  laser  flash  had  a  greater  effect  as  contrast 
decreased  and  for  the  natural  terrain  background.  The  case  in  which  this  rule 
did  not  apply  was  for  the  natural  terrain  background  at  the  0.15  RMS  contrast. 
However,  this  was  due  to  a  ceiling  effect  caused  by  the  time  limit  inposed  on 
the  search  times. 

The  second  interaction  involving  Background,  Contrast,  and  Zone  is  shown 
in  Figure  5.  This  effect  was  similar  to  the  3-way  interaction  cited  earlier, 
in  that  search  time  increased  as  contrast  decreased  and  as  background  changed 
from  uniform  to  dynamic  to  natural  terrain.  However,  the  order  of  these 
effects  depended  on  the  zone  in  which  the  target  was  located.  The  largest 
effect  was  seen  at  the  0.15  RMS  contrast.  No  differences  between  zones  were 
found  in  the  uniform  background  condition.  However,  an  advantage  for  targets 
located  in  the  inner  zone  was  observed  in  the  dynamic  background,  and  a 
disadvantage  was  seen  for  the  outer  zone.  The  opposite  was  true  for  the 
natural  terrain  background.  Here,  shorter  search  times  were  found  for  the 
outer  zone,  and  longer  times  were  observed  for  the  inner  zone. 

Another  significant  effect  was  found  in  the  Zone  X  Flash  interaction, 

F (2, 42)  -  8.41,  £  <  0.001.  This  interaction,  shown  in  Figure  6,  demonstrated 
that  search  times  were  shorter  as  the  target  moved  from  the  outer  to  inner 
zones  of  the  search  field  in  the  baseline  condition.  However,  this  advantage 
disappeared  in  the  flash  condition  where  a  slight  elevation  in  search  time  was 
observed  for  targets  in  the  inner  zone. 

We  also  examined  the  distributions  of  search  times  for  various  conditions. 
Upon  examination  of  these  distributions,  it  became  clear  that  a  considerable 
amount  of  variability  surrounded  some  of  the  conditions  but  not  others .  For 
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'V  ’* 


example,  variability  in  search  time  increased  ,uh,tanM  „ 

contrast  in  the  natural  terrain  ■  _  .  tantially  with  decreasing 

depicts  two  response  distributions  of  the ’bas^Line^***6/1118  point'  Figure  7 
condition:  the  0.15  and  the  0  45  rm<?  ®line  data  of  tfae  natural  terrain 

scattered  ..arch  t^s  diattii“ticn,  4how 

distribution  of  responses  for  the  0.45  RMS  L  Si-?  V®*ue  and  a  narrow 

two  distributions  represents  a  funda^n^Tl  differine.  ,Th*  diff,rence  in  these 
nature  of  this  difference  is  erplored  in  the  dfscusHon”  "  b"“',ior-  Th* 

DISCUSSION 

the  t arget 8 wa  {^searched  “ 

itself  did  not  change  It  is  Ler^n!  f  d  a9ainst,  even  though  the  target 
motion  had  on  t.roM^tMtabi^  r  *  tt  n°te  ““  f«=Uit.ti»»  effect 

£S.S5«SS5*‘ 

^  Search  times  of  the  dynamic  or  natural  terrain  background 

be  applied '  to  oH  ^ SOme  au99®«tion  that  a  simple  linear  scaler  could 
be  applied  to  go  from  detection  to  recognition  (van  Meeteren,  1990)  However 
this  does  not  seem  to  be  the  case  for  visual  search,  when  g^ng  from  ' 

detection  to  recognition,  as  evidenced  by  the  transition  from  the  uniform  to 
the  natural  terrain  background,  the  change  in  search  time  depended  on  target 
contrast  and  which  background  it  was  seen  against.  9 

The  large  variability  in  search  time  distributions  between  the  high-  and 
low-contrast  levels  suggested  that  more  than  one  factor  was  dictating  search 
performance.  The  results  indicated  that  contrast  alone  was  sufficient  to 
drive  search  performance  at  high-contrast  levels,  btft  not  at  low-contrast 
evels .  At  low  contrast  levels,  recognition  decisions  may  be  based  on  target 
shape,  edges,  or  other  features. 

.  Finally.  th®  effect  of  the  flash  was  to  increase  search  times.  Search 
times  were  not  uniformly  increased  but  varied  three-  to  tenfold  depending  on 
target  contrast,  background  complexity,  and  location  in  the  search  field. 

**  e*?lained  if  one  takes  into  account  that  only  the  central 
0  of  the  retina  was  flashed  and  that  the  sensitivity  of  the  peripheral 
retina  remained  unaffected.  Furthermore,  the  rate  at  which  each  retinal 

'°tCa  r°Vered  fr°m  the  flash  depended  not  only  on  the  flash  parameters 
but  also  on  the  sensitivity  of  a  particular  retinal  location  to  the  target. 

ACKNOWLEDGEMENTS 

Thanks  go  to  the  many  people  that  worked  on  this  project  including  Anthonv 
cutalano,  Jam.,  Br.kefi.id,  Gary  Noojin,  David  St.lar.ki,  Rowe  ElUott.^S  J 
the  Analysis  Branch  of  the  Directed  Energy  Division  (AL/OEDA) .  This  research 

He.”bPbiSof  ‘V1’*  “SAF  Al"3tr0n9  Occupational  and  Environmental 

»a-“S6!r:rseu?rLi:„dceErs.Division'  ^ 


61 


REFERENCES 


van  Meeteren  A.  Characterization  of  task  performance  with  viewing 

tqqnrUinentS "  — ■^ynal  of  the  Optical  Society  of  America  A.  7:  2016^-2023, 


62 


Contrast 


.45  RMS 


.35  RMS 


.25  RMS  .15  RMS 

Figure  3.  The  test  target  at  four  contrasts. 
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TARGET  IDENTIFICATION  REQUIREMENTS  IN  TACTICAL  SIMULATORS 
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Out-of-the-cockpit  visual  cues  are  required  for  many  of  the 
tasks  pilots  perform  in  normal  flight  operations,  as  well  as  air- 
.~air  combat  and  surface  attack  missions.  For  this  reason,  flight 
simulator  visual  systems  must  be  capable  of  displaying  the  visual 
cues  pilots  normally  use  at  the  distances  that  are  encountered  in 
actual  flight  conditions  to  provide  an  effective  training  medium 

these  tasks.  In  air— to— air  combat  sorties  performed  within 
visual  range,  the_  pilot  must  visually  distinguish  the  target 
aircraft  up  to  distances  of  three  nautical  miles;  in  surface  attack 
missions,  the  pilot  must  visually  identify  a  prescribed  target  from 
an  array  of  objects  on  the  ground;  and  in  landing  approaches, 
pilots  must  visually  monitor  the  terrain  surface  to  maintain  the 
proper  altitude  and  course  on  the  descending  approach. 

A  wide  range  of  visual  system  design  variables  can  influence 
the  visibility  of  cues  in  a  simulated  visual  scene,  however,  hence 
the  specific  values  of  these  variables  will  dictate  the  training 
effectiveness  of  the  simulation.  A  decade  ago  (Statler,  1981) ,  a 
seminal  paper  was  produced  entitled  "Characteristics  of  Flight 
Simulator  Visual  Systems,"  in  which  critical  design  parameter  were 
identified  and  defined.  The  paper  addressed  the  three  major 
properties  of  visual  systems;  spatial,  energy,  and  temporal 
properties.  The  spatial  parameters  included  f ield-of-view  size  and 
shape,  viewing  region  of  the  observer,  viewing  distance,  image 
mapping,  and  scene  content;  the  energy  properties  included  color, 
contrast,  luminance,  and  resolution;  and  the  temporal  factors 
included  scene  excursion  limits,  transport  delay,  noise,  refresh 
rate,  and  aliasing. 

Research  is  currently  being  conducted  at  the  Aircrew  Training 
Research  Division  of  the  Armstrong  Laboratory  to  establish  the 
visual  display  requirements  for  various  simulated  flight  tasks. 
In  one  investigation,  the  visual  cues  pilots  use  in  air  combat 
engagements  to  determine  the  orientation  of  the  target  aircraft 
were  investigated.  Additionally,  a  two-phase  evaluation  was 
accomplished  addressing  the  field  of  view  and  resolution  required 
for  area-of-interest  (AOI)  displays.  The  specific  objectives  and 
research  methods  corresponding  to  these  research  efforts  are 
described  below,  along  with  the  progress  to  date. 


Visual  Cue  Recruirements  for  Air  Combat  Simulation 

In  air-to-air  combat  engagements  that  are  performed  within 
visual  range,  pilots  fly  their  aircraft  at  or  near  the  limits  of 
the  performance  envelope  with  little  or  no  reference  to  inside 
instruments.  The  pilots  must  constantly  monitor  the  aspect  angle 
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wS  M„.^«^%aii”tr“^l<^,i°hI?ielat*  the  °«®nsive  or 
demands  imposed  upon  the  pilots  the  effLt  the  intense  visual 
simulator  for  air  Sombat  traininc'  wni  >lh  u^Veness  of  a  flight 
display  characteristics  of  the  visual  lnfluenced  by  the 

of  the  most  critical  rfieniat  ,  i®ulation  system.  Several 

brightness,  and  resolution  which  2diatoeJiSti?S  are  contrast, 
the  target  stimuli  are  visible  in  t^e  simulated  distances 

.visual  system  should  provide  the  viSal  cu^  ,  •SIC®ne*  MeaHy»  the 
the  simulated  distances  corresponding l  cues  pilots  normally  use  at 
order  to  real-world  °Perations.  in 

relevant  display  characterist  i  ®gui^®men‘ts  f°r  each  of  the 
realistic  training,  ttSTiroS  Purpose  of  providing 

they  are  acquired  must  first  be  establish  and  the  distances 

how  accurately6 p^^»tsf  Were:  <D  to  determine 

aircraft  images  ^  various  dlsSSces  *??,  i"9,16  of  tar3et 

cues  pilots  use  to  establish  J  ]  t0  ldentlfY  the  visual 

examine  the  ?n?luencfof d!ff22ht '  and  (3)  to 
on  aspect  angle  recognJtioJ  f?r^s.  Plt°h  a°d  bank  an^les 

scaieTF-l5  a8!!?*-  i^UlLWere-  Photographic  slide  images  of  1/48- 
scaie  F-15  and  F-16  fighter  aircraft  models.  The  Dilots'  ta=v  lc 

&  air rerent  aircraft  orientations  (aspect  ancle  direction  o-f 
travel.  Pitch  and 1  bank -combinations)  at  four  simulated  distances 
'  1;  2'  and  3  nautical  miles).  Four  groups  of  pilots  served  as 
observers  instructor  pilots,  C/TX  students,  B-Course  studlnS  anl 
“Pff^onal  Pilots),  and  20  pilots  were  used  in  each  group  Sne 

thi f  other11  h,^V°tS  ln  Ja?h.  SrouP  viewed  the  F-15  aircraft  Slides; 
the  other  half  were  administered  the  F-16  aircraft  slides  The 

A?Ba  I^and^thff  at  Hi“  AFB'  UT'*  Holloman  AFB  4;  LukJ 

AFB,  AZ,  and  the  Arizona  Air  National  Guard,  Tucson,  AZ. 

Data  collection  has  been  completed.  The  data  are  currentlv 
rllultTf/lli  ai^eastlgat1iorneP°rt  iS  ^  draftSd  to  dl™' t  the 


sSSi  It  i  f*9I)  n*spl3VPequi repents  for  Tow-Witude  Flight 

svstemJeterl~idi:xf^eSt^,(A?I)  disPlaYs  for  flight  simulator  visual 
systems  were  developed  m  response  to  a  requirement  for  hicrher 

movlSS  rh?ohU-tri°"1antd  ima?e  detail-  *01  dSpSyJ  co^Lt  If  a 

-  '  resolution  inset  that  is  surrounded  bv  a  lower 

tJacked10^^6"!?11,?16  per!iPheral  field,  and  the  AOI  mly  be  head 
of  the  most  critical  V-  S11fltane°usly  head  and  eye  tracked.  Two 
Visual  systems  arf  fjaracteristics  associated  with  AOI 

systems  are  AOI  field  of  view  (FOV)  and  resolution. 
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FOveandhrf^n^ed  t0  dat®  (^rner'  1984 >  indicates  that  the  AOI 
FOV  and  resolution  retirements  are  task  specific.  Consequently, 

a  research  program  comprised  of  a  progressive  series  of  display 

e^1Uat^°nS  *aS  lnitlated  at  ^e  Aircrew  Training  Research  Division 
addressing  the  effects  of  AOI  FOV  and  resolution  tradeoffs  on 
observer  perfopnance  in  simulated  low-altitude  flight.  Two 
investigations  in  the  study  series  were  conducted  and  a  third  is  in 
the  planning  stage. 


The  Limited  Field-of-View  Dome  ( LFOVD)  visual  simulation 
system  was  used  m  the  two  investigations  that  have  been  completed. 
The  LFOVD  provides  two  optional  AOI  displays:  a  small,  higher 
resolution  AOI  and  a  large,  lower  resolution  AOI.  The  FOV  size  of 
the  small  AOI  was  26.44  degrees  horizontal  by  20.51  degrees 
vertical,  and  the  resolution  (defined  as  the  width  of  the  line 
spread  function  at  50  percent  of  the  line's  maximum  luminance)  was 
0.081  degrees  horizontal  and  0.071  degrees  vertical.  The  FOV  size 
of  the  large  AOI  was  40  degrees  horizontal  and  30  degrees  vertical, 
and  the  resolution  was  0.132  degrees  horizontal  and  0.121  vertical. 
An  optical  blend  region  was  installed  between  the  AOI  inset  and  the 
surrounding  visual  field  to  provide  a  smooth  transition  between  the 
two  areas,  and  the  blend  regions  of  the  small  and  large  AOI  sizes 
were  2.5  and  5  degrees,  respectively.  The  instantaneous  FOV,  which 
is  specified  by  the  maximum  dimensions  of  the  surrounding  visual 
field,  was  60  degrees  vertical  by  140  degrees  horizontal.  The  AOI 
was  head  tracked  and  could  be  rotated  up  to  90  degrees  left  and 
right,  40  degrees  upward,  and  22  degrees  downward  from  a  point 
directly  in  front  of  the  cockpit  at  eye  level. 

The  objectives  of  the  first  investigation  were:  (1)  to 
determine  the  detection  threshold  distances  for  simulated  ground 
targets  in  the  small  and  large  AOI  displays  and  (2)  to  examine  the 
effects  of  various  stimulus  characteristics  on  the  detection 
thresholds.  The  stimuli  were  cylinder-shaped  objects  that  were 
placed  upright  on  the  terrain  surface  of  the  visual  database,  and 
both  striped  and  plain  cylinders  were  used.  The  striped  cylinders 
were  modeled  with  a  black  stripe  that  encircled  the  cylinders  and 
that  were  placed  midway  between  the  top  and  bottom  of  the 
cylinders.  The  plain  cylinders  were  modeled  without  the  stripes. 
Nine  different  cylinder  sizes  were  used,  which  were  produced  by 
combining  three  cylinder  heights  (50,  75,  and  100  feet)  and  three 
cylinder  diameters  (25,  50,  and  75  feet) .  Additionally,  two  stripe 
sizes  were  used  with  each  of  the  cylinder  sizes:  a  4-foot  and  an  8- 
foot  stripe.  The  stimuli  were  presented  in  the  center  of  the  AOI 
displays,  and  threshold  detection  distances  were  obtained  for  both 
the  cylinder  stripes  and  the  plain  cylinders.  For  the  cylinder 
stripes,  the  observers  moved  the  simulated  aircraft  backward  until 
the  stripes  disappeared  and  then  forward  until  the  .  stripes 
reappeared.  For  the  plain  cylinders,  the  observers  moved  the 
aircraft  until  the  entire  cylinder  disappeared  and  reappeared. 

The  analysis  of  the  thresholds  associated  with  the  cylinder 
stripes  indicated  that:  (1)  the  detection  distances  were  about  50 
percent  greater  on  the  average  with  the  higher  resolution  AOI  than 
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with  the  lower  resolution  AOI*  r>\  +•>,..  4. 

greater  for  the  8-foot-high  cylinder  1?^Ces  were  slightly 

high  stripes;  (3)  the  detectiondistfnc^ -E?S  ^an  f°r  the  4~foot- 
as  the  height  of  the  cylinders  i no rJl.fi!?  1:116  ®triPes  increased 
improvement  in  detection^istance  wa«s  *;®as®d'  wai?d  the  Percentage 
*and  intermediate  cylinder  heiahts  than  Sf®ater  between  the  shortest 
tallest  heights  used;  and  ?4  f  S?*  2jLween  the.  intermediate  and 
diameter  increased,  and  increased  as  the 

distance  was  greater  beSTeePner?hfaH®i^r0Jemen?  in  detection 
cylinder  diameters  than  between  the  lowest  and  intermediate 
diameters  employed.  The  detection  thr-c  h  1i!?ei?aedla^e  and  widest 
cylinders  we?e  governed  by  the  sett?nqs  usedS  fo°/  tT*  °f . the  Plai" 
generator  parameters.  Only  the  sma n i  a  ®  yari°us  image 
not  influenced  by  these  cylinder  diameters  were 

corresponding  to  the  4-fSSt  f5%23!n02*f!!Cti?n  distances 

sizes  are  provided  in  Figure  1  °5_  a?h,  ?he  nine  cylinder 

the  8-foot  stripes  are  shown  in  “Jurl  ?  ajr£he",,f in’T?68.  •  °r 
distances  for  the  Dlain  ana  tbe  Bean  detection 

specifics  ofthis  invest  e  presented  in  Figure  3.  The 

by  Warner,  Hubbard,  and  Serfoss  (in  p?els"?  ln  3  technical  report 
were  t^evalu°ateV' 'the^ewIolfof^oTVov93^0''  Etudy  series 

target^detection^task 

was  modeled  that  contained  both  target’ ‘  and'nontkrge^Klmuu!31’^ 
argets  were  striped  cylinders,  as  previously  described  and  t-h<= 
nontargets  were  plain  cylinders  without  stripes  six  iif?er2? 

thrie  cylinder  WheriohtseIJ;snhi vs  were„  formed  bY  the  combination  of 
diamJtSs  rTs  J  7?  f  <50'  JS.  end  100  feet)  and  two  cylinder 
a  4-fnr.h  <-/  •  nd  ?5  feet]  *  The  target  cylinders  were  modeled  with 
8^ripa*  °ne  cylinder  was  place  every  2,000  feet  along  the 
and  the  ,or.der  ln  which  the  cylinder  sizes  appeared  wal 
2/3  °ande?'TnnIi1  addV;?on'  t:he  cylinders  were  randomly  placed  1/3, 

visual  d3iah=  °n  e,lther  Slde  of  the  flight  path.  The  area  of  th4 
visual  database  containing  the  cylinders  was  33  miles  long.  Each 

cvfJ^T  pr/vi1ed  nlne  trials-  and  there  were  four  targS? 

fi,1  a.  tr?al*  Each  of  the  target  sizes  was  presentedat 
order-  S1?  target  locations  over  the  nine  trials,  and  the 

,  r  of  the  target  sizes  and  locations  was  randomized.  The 
observers  were  required  to  scan  the  visual  environment  and  press 
the  cockpit  gun  trigger  as  soon  as  they  detected  the  targets  The 

SSESTtSS. rns°etdhtaLe  srr1  °f  the  ai-taft.  The^mufated 
altitnd?  ^  d4- thm  database  at  a  speed  of  500  knots  at  an 

f  150  feet*  Target  detection  distance,  offset  angle,  and 
detection  errors  were  collected,  as  well  as  head  movements  Head 
movements  were  measured  with  a  Polhemus  head-tracking  system  The 

nonpSS  COnia^edof°f/hiX  "Z'  Air  F°r“  “^ructor  piloted  Sx 
onpixors.  Each  of  the  observers  performed  the  ta«sk  uifh 

aman,  hxghar  resclution  AOI  and  with*  the  TaergeU,Iowtar,Crasolut“n 


--try'  beingt  analyzed 

eport  will  be  prepared  addressing  this  investigation. 
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effects  on  visual  detectio 
Williams  Air  Force  Base,  AZ: 
Division,  Armstrong  Laboratory. 
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____  display  image  quality* 

SCALING  OF  CONTRAST,  BRIGHTNESS,  AND  RESOLOTION 

.  ,  Ronald  j .  Evans 

University  of  Dayton  Research  Insti  t»ts> 
Armstrong  Laboratory,  Williams  AFB,  ^Arizona 


provide  the  fidelity  amiable  fto9pilot?Uin 'kc't’  <?annot  currently 
scenarios,  with  improvements  in  ln  actual  out-the-window 

simulators  have  increasingly  more^Si'?7 '  t^OUgh'  designers  of 
simulator  displays  ranoino9fZm  v,°^e  ,°Pt;Lons  in  the  choice  of 

fiber  optics  or  s^all^?hode  rav  tSb.?''ftSf  displai's  *“«»  hP°n 
radius)  displays  which  tubes  to  large  dome  (10-20  ft 

systems.  Methods,  measures^or^aetri ^Pl°Y  muJt;LPle  projection 

decision  making  process  f S' TnT lpScS£.!°  ** 

application?Sit9is  i^o^Sn^thl^tS^r?^^1111119  °J. simulator 

quality  of  the  display  be  represent®?  .P®rf°raai}ce  capabilities  or 
apply  as  a  criterion  agaiiSt tte??  •  3  fashion  users  can 

air  intercept  taste?  Te.rTL?rlLllT£tT2tt^ ^  eXa“ple'  in 
range  of  five  miles,  implying  a  viral  an???  jletectl01?  occurs  at  a 
arc  minutes  for  a  20  foot  t»™Jt  JL*  gl  °f  aPPr°ximately  three 
whether  this  three  arc  “\er  »«t«  to  know 

££?  Su-^Sh^S 

£“££*£  ITsl'ZtV  pr;?erente!?itUte 

complex  as  such  a  multidimensional  process  is  to  model  it  i<=  =, 

relatively  simple  task  for  observers  to  view  t£o  diSmSs'  and  Ske 

is G lSs^ tlskU  s^icT/ic  1:1113  sub3«otive  preference  approach 

is  less  task  specific  than  the  performance  approach  it  has  hint 

high  correlat/37  definition  and  one  typically  expects  a  reasonably 

™  -  petf ormanca-basedy 

pe^SP8  F-?  noted^'above  ^^uiS 

Phv  ca  dS?'  based  software  which  allows  users  to  provide 

pe^foteance  P%a?Armesri=t?reand  W£L  r*ries  about  static 

recognition,  andP  ident?f?cati!>n  of  tar|ete?10and  m 

sa 3C3s.nssia.~~  - iJ- 

££22. 

ne  visibility  of  targets  on  a  specific  display  system  based  only 
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ss^tSff  ^n£9S:r  ™ 

9f*  rang  '  a  blow-up  of  image  #2  will  be  made  which  shows 
what  features  from  the  target  can  actually  be  reoresent S  hfJhf 
display  of  interest  at  the  designated  target  rancre  f  imarrr*  ^#0  _ 
bl°w_up)  *  .  Figure  1  shows  an  example  of  the  three9  images 
JW-  on  a  single,  bigh  resolution  screen.  Note  that  the  pixel 
blow-up  is  performed  with  rectangular  pixels.  One  limitation  of 

ahav1l  iL^at  thG  <!isplay  ployed  for  showing  the 
^aga5J  aust  have  better  resolution  than  the  display  being 

Otherwise,  it  would  be  possible  for  an  image  to  be 
resolvable  on  the  simulated  display  but  not  the  PC  display. 

The  pictorial  representation  in  Figure  l  provides  the  user 
with  practical  information  with  which  to  make  display  procurement 
decisions.  The  images  in  Figure  1,  however,  are  not  corrected  for 
luminance  or  contrast  so  only  actual  stimulus  size  and  feature 
content  are  mapped  onto  the  images  in  Figure  1.  The  capability  to 

.  Pre<?ictioi*s  (e.g.,  detection,  heading, 
recognition,  identification)  depends  upon  the  local  luminance  and 

h*1®  ta5get'to“background  contrast  as  well  as  the  visual  angle 
subtended  and  the  resolvability  of  target  features.  9 

A  variety  of  theories  exist  concerning  the  required  target 
information  necessary  for  different  levels  of  visual  performance. 
The  software  currently  being  developed  will  assume  that  all  levels 
of  visual  performance  depend  only  on  the  detection  of  a  feature 
(e.g.,  the  entire  target,  the  nose  of  an  aircraft)  designated  by 
the  user.  The  luminance,  contrast,  and  visual  angle  subtended  by 
the  feature  of  interest  will  then  determine  whether  the  task  can  be 
accomplished,  or  alternatively,  given  luminance  and  contrast,  the 
software  will  estimate  the  range  at  which  the  task  may  be 
The  software  will  use  previous  detection  performance 
data  (e.g.,  Blackwell,  1946)  to  estimate  detectability  curves  based 
upon  luminance,  contrast,  and  visual  angle  parameters. 

?«e>i^0f^Ware  described  above  provides  a  practical  tool  to  be 
SI  procurenient  or  d«sign.  Alternative  approaches  may 

b®  .u.®®d  whlch  ar®  more  quantitatively  oriented.  These  image 
quality  measures  focus  on  the  integration  of  physical  display 

alda?hterl'  weight®d  fay  natural  characteristics Yof  the  imagery 

Xn}?  a,  nuineri?ai  aetric  from  which  the  relative 
S  quality  of  a  display  device  may  be  ascertained.  To  date 

tunation  f^  “2th*  «isplay  Modulation  SaS5S 

iSCludl^ 1  he  pri“ary  display  parameter  of  interest  and 

luminance  m  an  indirect  fashion.  The  Modulation 

Root  lit e,a  ^FA)  (see  Snyder,  1985)  and  the  Square 
R°?t  Integral  (SQRI)  (Barten,  1987)  are  two  image  quality  metrics 

which  use  the  display  MTF  and  observer  Contrast  Sensitivity 
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toe  spatial  frequanc^^anga  ot  toe  dilplSC  Wh*=h  is  integrated  over 
es  examples  of  two  wiys  il  whic*  thl  dP<l  ^  These  “trios  are  used 
weighted  over  the  spatiS  framed  d“?lay  MTP  is  differentially 
observer  characteristics.  ^  ^  according  to  image  and 

perforaed^which 9  a^a'fiS?'  a'fP^iments  and  analyses  are  being 
importance  of  the  display  MTF  and^  luinfn^ermX”lng  the  relative 
quality  and  (2)  finding  appropriate  wa^  t« ^  2  Perceived  image 

f  d^PlaY  parameters  based  upon  the  chara^619^  ?etrics  composed 
and  the  observer.  Static  im^aeS  characteristics  of  the  image 

mathematically  represented  display  ^WIFs^  filtered  using 
comparison  of  these  filtered  MTFf*.  Presentation  and 
yields  an  estimate  of  change  in  Derce^J1^  resolution  display 
function  of  change  in  5ie 9 displa^  mtp  d  as  a 
indicate  that  small  changes  in  disnla^^V  Prel binary  results 
numerical  metrics  and  that  displaJ  u  °veremPhasized  in 
role  m  metrics  relative  to  the  curr^i"  u  should  Play  a  greater 
these  metrics.  Experiments  are  planed  disPlay  MTF  in 
vary  display  MTF  along  with  disolav  i«I?XCh  Wl1.1  also  factorially 
relative  importance  o/the^ 
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Figure  1.  Image  Generation 
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PSYCHOPHYSICAL  ASSESSMENT  OF  WTOF-Frem 
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George  A.  Geri 
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Introduction 

The  information  processing  capability  of  the  human  visual  system  decreases  from  the  center  of  the  visual 
field  to  the  visual  periphery.  The  quantitative  nature  of  the  decrease  depends  on  the  visual  task  being  performed. 
For  instance,  the  capability  to  perform  simple  luminance  or  contrast  discriminations  decreases  less  with 
eccentricity  than  the  capability  to  perform  certain  spatial  localization  tasks.  In  any  case,  a  so-called  cortical 
magnification  factor  (CMF)  can  be  specified  which  relates  the  sensitivity  at  a  given  retinal  eccentricity  to  that  at 
the  fovea.  The  CMF  is  presumed  to  reflect  the  relatively  greater  number  of  cortical  cells  associated  with  a  given 
retinal  area  near  the  fovea  as  compared  to  an  equivalent  area  in  the  periphery.  .Thus  it  follows  that  the  number 

of  cortical  cells  stimulated  can  be  equated  for  stimuli  in  the  center  and  periphery  if  the  latter  are  appropriately 
increased  in  size. 


A  number  of  CMFs  can  be  used  to  estimate  a  cortical  magnification  function  (CMFn)  which  will  specify 
how  visual  sensitivity  changes  for  a  particular  task  across  the  visual  field.  CMFns  estimated  by  anatomical  and 
psychophysical  techniques  have  been  shown  to  be  consistent  for  many  simple  visual  discriminations.  More  recent 
evidence  has  suggested,  however,  both  quantitative  and  qualitative  discrepancies  between  the  anatomical  and 
perceptual  data  especially  when  more  complex  stimuli  are  used.  In  order  to  determine  whether  different 
perceptual  CMFns  are  associated  with  the  discrimination  of  complex  texture  stimuli,  we  have  used  wide 

field-of-view,  variable-resolution  images  to  estimate  the  minimally  detectable  degradation  in  image  fidelity'  with 
retina]  eccentricity. 


Method 


Stimuli  and  Apparatus.  Two  real-world  aerial  photographs  were  first  digitized  and  then  processed  using 
a  special-purpose  program  which  locally  bandlimited  (i.e.,  blurred)  the  image  as  a  function  of  radial  distance 
from  the  center.  The  processing  was  performed  with  position-varying  Gaussian  integrating  kernels.  Linear 
functions  (see  Figure  1)  were  chosen  to  vary  the  parameters  which  specified  the  integration  kernel  as  a  function 
of  distance  from  the  center  of  the  image.  These  functions  were  chosen  to  approximate,  to  varying  degrees,  a 
CMFn  which  was  derived  from  anatomical  data  and  which  was  consistent  with  several  previous  psychophysical 
studies.  In  the  first  study,  each  image  pair  (see  below)  covered  a  circular  area  that  was  80  degrees  in  diameter. 
In  the  second  study,  segments  of  the  original  images  were  used.  The  radial  dimension  of  the  segments  was  8 

degrees  and  their  angular  dimension  was  varied  between  3.3  and  67.5  degrees.  All  stimuli  were  presented  for 
150  msec. 

The  processed  stimuli  were  presented  using  a  Barco  projector  and  a  ground-glass  screen.  One  half  of 
each  stimulus  was  always  the  original  image.  On  one-half  of  the  trials,  the  other  half  of  the  stimulus  was  a  mirror 
image  of  the  original,  while  on  the  other  half  of  the  trials,  the  other  half  of  the  stimulus  was  one  of  the  series  of 
progressively  more  processed  images  derived  from  that  original. 
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Procedure.  Following  a  period  of  adaptation  to  the  ambient  illumination  of  the  experimental  toom  the 
observers  were  shown  the  stimulus  pairs  and  were  asked  to  tespond  as  to  which  side  of  the  stimulus  appeared 
to  be  more  highly  processed  (i.e.,  more  blurred). 

Results 


The  discrimination  data  obtained  from  all  threeabservers  are  summarized  in  Figure  1  The  four  plots 
assoc, ated  with  each  observer  correspond  to  the  four  sets  dissolution  functions  tested.  Based  on  the 
percentage  of  correct  responses  (%Q.  tbreefeads  were  used  to  categorize  the  observers’  ability  to  discriminate 
an  unprocessed  image  from  an  image  processed  according  to  each  of  the  functions  within  each  set  The 
dark-shaded  areas  of  Figure  1  encompass  the  variable-resolution  functions  that  were  discriminated  more  than 
85  xc  of  the  time,  while  the  white  areas  encompass  the  functions  that  were  discriminated  at  near  the  chance  level. 
Discrimination  percentages  between  these  extremes  were  defined  as  bang  at  or  near  threshold  and  are  associated 
with  the  stippled  areas  shown  in  the  figure. 


Observer  SF  was  able  to  discriminate  the  low-pass  filtered  images  somewhat  better  than  observer  GG 
who  in  turn  was  somewhat  more  sensitive  than  observer  KV.  Despite  these  quantitative  differences,  all  observers 
showed  qualitatively  similar  patterns  of  sensitivity  across  the  four  sets  of  stimuli  tested.  For  instance,  whereas 
discrimination  performance  declined  as  the  size  of  the  integration  kernel  applied  to  the  peripheral  edge  of  the 
image  was  decreased,  the  decline  could  be  compensated  by  a  (generally  smaller)  increase  in  the  size  of  the  kernel 
used  at  the  more  central  edge  of  the  image.  The  variaWd-res^ttticm  functions  which  were  estimated  to  be  at  or 
near  threshold,  for  each  observer,  bear  seme  resemblance  to  CWRjs estimated  from  simple  contrast  sensitivity 
data-although  the  metric  most  appropriate  for  comparing  these  two  fypes  of  data  remains  to  be  determined. 
Conclusions 


The  slope  of  the  CMFn  that  produced  a  minimally  discriminable  image  was  very  similar  to  the  slopes 
estimated  from  luminance  and  contrast  sensitivity  data.  Thus  the  discrimination  of  low-pass  filtered  (i.e.,  blurred) 
images  appears  to  be  largely  dependent  on  image  properties  defined  by  such  fundamental  measures  ascomponem 
spatial  frequency  and  orientation. 

Similar  discrimination  data  have  been  obtained  for  several  visually-diverse,  complex  images,  suggesting 
that  the  visual  equivalence  of  variable-resolution  images  is  independent  of  local  variations  in  image  detail. 

The  contribution  of  various  parts  of  a  low-pass  filtered  image,  to  the  visual  discrimination  of  image  blur, 
summate  in  the  sense  that  more  blurring  in  the  periphery  can  compensate  for  less  blurring  near  the  center  oi 
the  image  and  vice  versa.  However,  the  preliminary  results  of  the  segmented-image  study  indicate  that  the 
summation  area  for  these  stimuli,  if  it  can  be  defined  at  all,  doesnot  change  in  accordance  With  the  CMF  estimated 
from  full-field  images. 
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Development  and  Evaluation  of  an  Eye  Measurement  System  for  Flight 


Paul  A.  Wetzel,  Ph.D. 
University  of  Dayton  Research  Institute 
Williams  Air  Force  Base,  AZ 


Introduction 


ar  6ya  uatl0ns  of  eye  Peking  measurement  systems  for  use  in 

dl$P  f  sysleifs>  have  been  conducted  in  an  attempt  to  quantify  their 
performance  (Longndge  et  al.,  1989  .and  1990,  Wetzel  et  al.,  1990a  and  1990b)  One 
important  result  from  these  studies  has  been  the  selection  and  further  improvement  of  an 
eye  measurement  system  for  use  in  the  Fiber  Optic  Helmet  Mounted  Display  (FOHMD) 
An  experimental  approach  for  evaluation  of  a  two-dimensional  CCD  array  eye  tracking 
system  based  on  a  knowledge  of  oculomotor  behavior  for  data  collected  under  controlled 
laboratory  conditions  and  from  the  FOHMD  is  described.  The  results  of  these  experiments 
have  been  used  as  a  guide  for  further  development  and  improvement  of  the  eye  tracking 
system  for  use  with  the  Fiber  Optic  Helmet  Mounted  Display. 


In  order  to  evaluate  the  performance  of  an  eye  tracker,  it  is  important  to  be  able  to 
separate  and  distinguish  oculomotor  behavior  from  eye  tracker  behavior.  It  is  well  known 
that  the  function  of  the  oculomotor  control  system  is  to  accurately  align  and  stabilize  the 
high  resolution  portion  of  the  retina  known  as  the  fovea  with  a  visual  target  or  point  of 
interest.  Images  of  objects  or  points  of  interest  that  fall  beyond  the  foveal  area  of 
approximately  2mm  diameter,  or  about  5°  of  visual  angle,  are  poorly  resolved  The 
"difference  between  the  image  of  the  target  on  the  retina  and  the  fovea  can  be  thought  of 
as  an  error  signal  that  provides  the  driving  signal  behind  many  characteristic  eye  movement 
responses.  Generally,  if  the  retinal  error  signal  between  the  target  object  and  fovea  is 
greater  than  0.5°,  eye  movements  are  made  to  reduce  the  difference  error  (Wetzel.  1988). 


Materials 

The  eye  tracking  system  was  used  to  measure  the  eye  position  of  subjects  in  response 
to  step  changes  in  target  position  along  the  horizontal,  vertical  and  oblique  display  axis.  The 
difference  between  target  position  and  measured  eye  position  was  then  used  as  a  method 
for  assessing  the  accuracy  of  the  eye  tracking  system.  It  was  assumed  therefore,  that  position 
errors  greater  than  0.5°  that  were  not  reduced  by  corrective  eye  movements  were  most  likely 
attributable  to  the  eye  measurement  system  and  not  to  the  oculomotor  control  system. 
Residual  errors  that  remained  after  stable  eye  position  had  been  achieved  were  likely  to  be 
a  result  of  inaccuracies  in  the  eye  tracker  which  allowed  characterization  of  its  performance. 

,__A  d]aeram  showing  the  basic  components  of  the  Fiber  Optic  Helmet  Mounted  Display 
(FOHMD)  is  shown  in  Figure  1.  The  FOHMD  provides  high  brightness,  wide  field,  high 
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Figure  1.  Components  of  the  CAE  Electronics  Fiber  Optic  Helmet  Mounted  Display  shown 
without  the  eye  tracking  system.  J 


and  low  resolution  computer-generated  color  collimated  imagery  to  each  eye  via  coherent 
fiber  optic  bundles  and  Pancake  Windowtm  eyepieces.  The  computer  generated  imagery 
that  is  seen  by  the  wearer  of  the  helmet  is  determined  by  the  combined  measurement  of 
both  head  and  eye  position.  The  position  of  the  head  is  measured  by  an  optical  head 
tracking  system  which  determines  the  location  of  the  low  resolution  background  imagery- 
while  eye  position  determines  the  location  of  a  smaller  high  resolution  inset.  The  field  of 
view  of  each  eyepiece  and  the  region  of  high  resolution  inset  movement  is  shown  in  Figure 
2.  The  instantaneous  field  of  view  from  both  eyepieces  is  127°H  by  67°V  with  a  maximum 
binocular  overlap  of  38°  at  the  center.  Within  the  central  field  of  60°H  by  40°V,  signals  from 
the  eye  tracking  system  are  used  to  control  the  location  of  a  smaller  rectangularly  shaped 
25  H  by  19  V  high  resolution  inset.  To  minimize  the  change  between  the  high  and  low 
resolution  areas  a  video  blending  technique  is  used  to  smooth  the  transition  between  them. 


Figure  2.  Field  of  view  of  the  helmet  mounted  eyepieces  and  the  area  of  high  resolution 
+20°V1OVement  SS  COntrolled  by  eye  Position-  The  range  of  inset  movement  is  ±30°H  by 
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The  optical  components  and  two-dimensional  « 
mount  to  the  left  eyepiece  frame  of  the  heWt  l  C5°  °r  array  of  the  eye  fracker 

system  outputs  estimates  of  eye  position  a,  60  Hz  ustagTdark  pup[Aec4uV  n'Se  1r 


Tvs8,em  3TheVZeeCCLFCmre",S  “l"*60  ”Z  CC°  ”~*»»*a*  array  eye  tracks 
?  u  .  V  h  LED  IR  sources  llluminate  the  eye  and  serve  as  corneal  reflection  no.nts 
for  the  dark  pupil  eye  tracking  system.  Algorithms  utilize  an  estimate  of  pupil  cente^  and 
corneal  location  m  order  to  estimate  eye  position  and  compensate  for  helmet  slip. 


LED  sources  fixed  to  the  eyepiece  frame  illuminate  the  eye  with  less  than  1  mW/cm2  of 
radiated  energy  and  also  serve  as  the  corneal  reflection  points.  The  relative  change  between 
pupil  center  and  corneal  positions  provides  sufficient  information  for  discrimination  between 
eye  movement  and  helmet  slip.  Infrared  light  reflected  from  the  eye  passes  through  the 
eyepiece  lens  to  a  dichroic  mirror  which  directs  the  IR  image  of  the  eye  to  the 
two-dimensional  CCD  array  camera  located  directly  above.  Algorithms  process  the  eye 
image  and  provide  an  estimate  of  eye  position  at  a  60  Hz  rate  with  a  delay  of  no  more  than 
frames.  Total  weight  of  the  helmet  mounted  eye  tracker  components  is  50  grams. 

Eye  position  is  determined  by  computing  the  difference  between  appropriately  scaled 
signals  from  the  estimated  pupil  center  and  the  locations  of  the  corneal  signals.  When  an 
ye  movement  occurs,  the  corneal  highlights,  which  are  reflections  off  the  nearly  spherical 
surface  of  the  cornea,  move  at  different  rates  relative  to  that  of  the  pupil  center  When  a 
translation  of  the  eye  tracker  occurs  due  to  helmet  slip,  both  the  corneal  highlights  and  pupil 

a  ”  ,'  tfon' of  «he°“ye ^  ^  todicatinS  a  Nation  <*  <»e  eye  tracer  rather  tan 
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Methods 


Eye  movement  experiments  were  conducted  in  both  the  Fiber  Optic  Helmet  Mounted 
Display  and  the  laboratory.  In  both  sets  of  experiments,  subjects  were  instructed  to  follow 
as  accurately  as  possible  a  target  while  it  stepped  randomly,  in  separate  trials,  along  the 
horizontal,  vertical,  and  oblique  axes.  Horizontal-vertical  stimulus  coordinate  positions  were 
uniformly  distributed  over  a  0°  to  ±30°  range  in  two-degree  increments.  An  additional  set 
of  stimuli  were  used  to  examine  small  eye  movement  response  along  all  axis  for  target 
displacements  less  than  1°  from  center. 

Ten  observers,  all  with  normal  vision,  9  males  and  1  female,  participated  in  the  FOHMD 
experiments  and  five  of  the  10  subjects,  4  males  and  1  female,  also  participated  in  the 
laboratory  experiments.  An  experimental  session  including  scheduled  rest  periods  required 
approximately  one  hour  and  included  the  presentation  of  4  groups  of  5  trials  each. 

All  experiments  were  conducted  with  room  lights  off.  Prior  to  each  experiment  and 
between  groups  of  4  trials,  a  seven-point,  ±15°  calibration  procedure  requiring  under  one 
minute  to  complete  was  performed  along  the  horizontal  and  vertical  axes  only. 

In  the  laboratory,  subjects  were  seated  a  distance  of  57  centimeters  away  from  a  1.25H 
x  IV  meter  flat  display  screen  while  they  viewed  a  rear-projected  He-Ne  laser  target  spot 
that  subtended  a  visual  angle  of  0.1°.  A  pair  of  computer-controlled  XY  mirror 
galvanometer  motors  was  used  to  control  the  position  of  the  target.  Changes  in  head 
position  were  minimized  by  the  use  of  a  molded  dental  bite  bar,  head  and  chin  rest  support. 
The  FOHMD  helmet  optics  and  eye  tracker  were  then  mounted  to  the  head  support  system 
and  the  stimulus  target  was  seen  through  the  FOHMD  eyepieces.  Prior  to  the  start  of  the 
experiment,  subjects  were  aligned  with  respect  to  the  exit  pupil  of  the  helmet  optics  using 
an  externa]  light  source.  In  all  experiments,  the  position  of  the  left  eye  was  measured. 

In  the  FOHMD  experiments,  each  subject  wore  an  individually  fitted  helmet  that 
supported  the  aligned  helmet  optics.  The  stimulus  consisted  of  an  easily  distinguishable 
bright  white  cross  hair  that  subtended  a  visual  angle  of  approximately  1.5°.  In  all  trials,  the 
high  resolution  inset  was  not  used  and  head  tracking  was  disabled 

Results  and  Discussion 

The  collected  data  from  each  subject  and  trial  were  first  inspected  with  ah  interactive 
display  program  which  visually  showed  the  relationship  between  the  stimulus  and  response. 
During  this  procedure,  responses  which  were  suspect  due  to  eye  blinks  or  cases  where  the 
subject  could  not  locate  the  target  were  identified  and  subsequently  eliminated  from  further 
analysis.  The  mean  and  standard  deviation  of  the  sample  population  response  for  each  trial 
was  then  computed  by  a  response  averaging  program.  An  analysis  program  was  then  used 
to  compute  the  weighted  position  error  and  standard  deviation  between  the  sample 
population  response  and  the  actual  target  position.  The  sample  population  results  of  these 
analyses  were  confirmed  again  by  subsequent  inspection  of  the  response  data  with  the 
interactive  display  program. 
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left,  the  corneal  reflection  resulting  from ^ the^m^fcTn,  ^  farther  ,0  ,he 

whose  radius  of  curvature  is  rouehlv  half  that  nf  mToves  closer  to  scleral  surface 

eye  tracker,  all  three S *”  ,he  Presem  «"*»  of  the 
particular  eye  position  results  in  a  corneal  reft  ~0r^  m  estmtating  eye  position.  Thus,  if  a 
ignored  in  favo'r  of  Z  ““  ^  S“rfa“’  “  “»  be 


Figure  4.  Response  data  (mean  ±  sd)  for  laboratory 
ideal  response  given  by  straight  line  diagonals. 


and  FOHMD  experiments  with  the 
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Laboratory  data  from  the  small  target  displacement  studies  reveah-H  that  .a  .  , 

was  consistently  able  to  resolve  changes  in  ere  position  as  small  T 

rat,o  being  the  limiting  factor.  A  sample  reirttogs  of  e^e  ^sition  Sata  SuS  frornme' 

isThown  inFi^,re  5ent,Cal  S'gmentS  Under  b°'h  hetoet  and  lab°™ory  conditions 
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F,8,U^hC0nipariS0n  °f  the  sma11  eye  movement  response  of  one  subject  under  laboratory 
and  FOHMD  conditions  for  an  identical  sequence  of  target  movement. 


Under  laboratory  conditions,  head  position  was  firmly  stabilized  while  the  head  was  not 
during  the  helmet  experiments.  The  differences  between  the  sensitivities  maybe  attributable 
to  small  amounts  of  helmet  slip  or  to  helmet  slip  compensation  methods.  The  amount  of 
noise  present  in  the  system  determines  the  boundary  conditions  under  which  area-of-interest 
isp  ay  systems  operate.  As  such,  output  noise  from  the  eye  tracker  or  other  systems  will 
determine  the  amount  of  jitter  present  in  the  high  resolution  area  of  interest.  At  the  present 
time  however,  the  amount  of  noise  or  jitter  in  the  FOHMD  is  not  a  serious  factor  since  the 
size  or  area  of  the  high  resolution  inset  is  considerably  greater  than  that  of  noise  level. 
However,  !f  the  size  of  the  mset  were  to  be  significantly  reduced,  such  as  in  proposed  eye 

controlled  variable  acuity  displays,  then  the  level  of  noise  would  become  a  far  more  serious 
concern. 
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ABSTRACT 

Tim  statly  was  designed  to  determine  whether  the  conjugate  eye  movement  tracking  of  carrier- 
based  fighter  pilots  is  different  from  that  of  controls.  We  hypothesized  that  compared  to  a 
seamen  control  group,  pilots  flying  high  performance  aircraft  have  superior  ocular  tracking 
capabilities  because  of  the  highly  visual  demands  of  the  flying  task.  We  used  an  infrared  limbus 
tracker  to  measure  the  eye  movements  of  65  subjects  in  the  U.S.  Navy  (ages  18  to  45  years;  31 
pilots,  29  controls  and  5  helicopter  pilots).  All  subjects  tracked  19  trials  of  a  small  (0  4°)  line 
on  a  CRT  (max.  amplitude  =  17°).  All  subjects  tracked  the  following  waveforms:  two  square 
waves  (0.25  and  1.0  Hz),  two  types  of  random  square  waves  (multiamplitude  and  ternary),  four 
sine  waves  (0.1  to  1.0  Hz.),  a  random  smooth  waveform  and  five  repetitions  of  a  cubic  waveform 
(1  Hz).  The  mean  deviations  (MD;  mean  absolute  value  of  the  eye  position  vs.  the  stimulus)  for 
the  cubic  waveforms  were  all  significantly  smaller  for  the  pilots  compared  to  the  controls  (p= 
0.048  to  0.002,  e.g.,  MDs,  trial  1:  2.2°,  s.d.=  0.4°  vs.  2.7°’,  s.d.=  0.7°).  Although  the  MDs  of  the 
eye  from  the  stimulus  were  generally  in  the  hypothesized  direction  for  the  other  waveforms,  none 
reached  statistical  significance.  We  conclude  that  there  is  evidence  suggesting  that  there  are 
differences  in  the  ocular  tracking  capabilities  of  these  two  groups  of  subjects.  These  differences 
may  prove  useful  in  the  selection,  evaluation  and/or  training  of  individuals  performing  complex 
tasks  where  vision  is  a  major  component. 


INTRODUCTION 


Flying  high  performance  aircraft  requires  a  high  degree  of  motor  coordination  considering 
the  high  speeds  and  the  cost  of  errors1 3.  Decisions  at  these  high  speeds  must  be  madp  quickly 
and  accurately1'5.  Accurate  eye  movements  are  a  significant  factor  in  flying4-6.  Various  ocular 

movements  are  used  to  scan  the  instrumentation  in  the  cockpit  as  well  as  to  see  other  aircraft  or 
structures  and  land  the  plane. 


Presently,  although  they  are  generally  considered  to  be  significant,  the  relative  importance 
of  accurate  eye  movements  in  the  performance  of  a  complex  visuomotor  task  such  as  flying  is 
unknown.  Such  a  question  is  difficult  to  answer  precisely  because  there  is  a  large  degree  of 
variability  between  the  ocular  movement  capabilities  of  normal  subjects8"14.  In  this  regard,  there 
are  a  large  number  of  factors  which  have  been  shown  to  effect  the  eye  movement  capability  of 
such  as  the  effects  of  attention  and  fatigue8-9' 13>  15'18. 
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were  a  result  of  experience  related  to  the  differing  visual  demands  betweenfae  groups. 

The  purpose  of  this  study  is  to  determine  whether  there  are  ocular  tracking  rfifWno« 

^  fa  fa?  £Tn  °f  with  ^  <*«»™  ™ual  demands:  cairSb^  figh“ 

pilots  m  the  U.S.  Navy  and  seamen  assigned  to  a  U.S.  Navy  cairier.  If  there  ate  diflenmees 
between  these  groups,  then  it  is  likely  fast  further  investigation  may  allow  e« 

fas“al  *ZSUl  faC'°r  "  1,16  “d/°r  "***  of  a™“s  *"d  *«*•  "ifa 


METHODS 


Subjects 

All  pilots  were  selected  from  four  squadrons  of  carrier-based  pilots  in  the  U.S.  Navy, 
ontrol  subjects  were  recruited  from  among  seamen  serving  upon  the  aircraft  carrier  U.S. 
America  where  the  majority  of  the  data  collection  took  place. 

Stimulus  and  Eye  Movement  Measurement 

The  stimulus  was  a  computer-controlled  fine  green  line  (0.4°  in  length)  moved 
electronically  about  the  face  of  a  cathode  ray  tube  (CRT;  Tektronix  Model  604;  Beaverton,  OR). 
Data  were  recorded  from  both  eyes  using  an  infrared  limbus  tracker16  (Applied  Science 
Laboratories  Model  200;  Walthan,  MA). 

The  basic  measure  of  tracking  ability  used  to  compare  the  two  groups  for  all  waveforms 
was  the  mean  deviation  (MD).  This  is  the  square  root  of  die  mean  squared  retinal  error15, 25'26. 
Fourier  analysis  and  cross  correlations  of  the  data  were  also  used  where  appropriate. 


RESULTS 


We  recruited  a  total  of  65  male  subjects  between  the  ages  of  18  and  45  years.  Tbe  pilot 
group  had  a  statistically  greater  mean  age  than  the  other  groups  (Fa62)  =  4.99,  p  =  0.01). 

Figure  1  shows  MD  and  its  associated  95%  confidence  limits  for  each  of  the  waveforms 
for  the  two  groups.  Probability  values  for  the  hypothesis  of  differences  between  the  groups  are 
shown  m  parentheses.  Differences  between  the  groups  in  tracking  the  cubic  waveform  were 
significant:  the  pilots  had  smaller  errors  (Fa  J9)  =  3.26;  p  =  0.04). 
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Figure  2  shows  MDs  for  the  cubic  waveform  for  the  pilots  and  controls  for  the  five  trials 

fJP?  ^  which  remained  consistently  below  that  of  the  controls  by 

about  0.3  to  0.4  a  15  to  20%  smaller  error.  There  was  a  significant  trial  effect  (p  =  0.05) 
suggesting  that  the  MD  of  the  groups  decreased  with  practice  (i.e.,  they  learned  the  waveform) 

n  e^T  S™6  nme’  thc?  WaS  n0t  a  ^gmficant  interaction  between  the  group  and  the  trial  (p  = 
0.83).  This  suggests  that  the  groups  learned  the  waveform  at  the  same  me.  On  each  trial  the 

lere!  fcf  tiificrences  in  MD  between  the  groups  ranged  from  0.01  (trials  l’and 
2)  to  0.29  (trial  4;  Kruskal- Wallis  tests). 


Figure  3  shows  cross  correlograms  averaged  over  all  of  the  trials  of  the  cubic  waveform 
for  the  pilots  and  the  controls.  This  suggests  that  the  pilots  were  better  able  to  match  the 
trajectory  of  the  target  with  the  eye. 


Figure  4  shows  periodograms  averaged  over  all  trials  of  the  cubic  waveform  for  the  pilots 
and  the  controls.  The  pilots  do  not  show  any  greater  tendency  toward  matching  the  stimulus 
penodogram  than  do  the  controls.  This  suggests  that  the  pilots  do  not  generally  follow  certain 
stimulus  components  of  the  waveform  better  than  the  controls. 


DISCUSSION 

This  study  suggests  that  the  oculomotor  tracking  capabilities  of  carrier-based  pilots  are 
superior  to  the  seamen  serving  as  a  control  group.  The  pilots  tracked  the  cubic  waveform 
significantly  better  than  the  control  group.  This  waveform,  possibly  because  it  does  not  exist  in 
nature  and  therefore  negates  the  effects  of  experience,  was  hypothesized  as  the  most  likely 
tracking  task  where  differences  in  capability  would  be  detected.  The  primary  reason  that  the 
pilots  were  superior  to  the  controls  was  that  they  were  more  consistent  than  the  controls.  This 
is  shown  in  the  cross-correlation  analysis  of  the  cubic  waveform:  the  pilot’s  distribution  is  of 
larger  magnitude  and  is  narrower. 

This  group  of  pilot’s  oculomotor  capabilities  were  not  uniformly  superior  to  those  of  the 
control  group.  In  contradistinction  to  professional  baseball  players24,  the  pilots  did  not  follow 
the  faster  frequencies  more  proficiently. 

Ta^seri25-Sgelher  With  1116  rcsults  of  Previous  studies  by  Daum  et  al24  and  Bahill  and 
colleagues  ,  these  suggest  that  certain  groups  of  individuals  have  better  capabilities  in 
tracking  than  others.  In  contrast  to  the  pilots,  the  professional  baseball  players  appear  to  have 
smaller  mean  tracking  errors  primarily  because  of  a  greater  capability  to  track  the  faster 
components  of  the  waveform24. 

This  study  also  suggests  that  it  would  be  appropriate  to  study  the  relationship  between  eye 
movement  capability  and  training.  In  particular,  a  pan-task  training  approach  to  aviation 
activities  requiring  fine  control  of  the  eyes  may  prove  useful.  Obtaining  improved  ability  to 
control  the  eyes  through  training  may  allow  better  performance  in  the  overall  task. 
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VISION  AND  VISIBILITY  ISSUES  IN  U.S.  NAVY 
LANDING  CRAFT,  AIR  CUSHION  (LCAC)  CREW  PERSONNEL 

Phillip  Hunt,  CDR,  MC,  USNR 

Naval  Health  Research  Center 
P.O.  Box.  85122 
San  Diego,  CA  92138-9174 


__  The  Landing  Craft,  Air  Cushion  (LCAC)  is  the  U.S.  Navv's 

51?!?  spe?d'  hl9h  technology,  amphibious  assault  craf/  This 
state  of  the  art  hovercraft  has  made  rapid  over-the-horizon  Toth? 
support  possible  for  over  80%  of  the  world's  beaches  ] 

17%acf\h.raft  1C,°,Uld  °nli;  travel  “P  to  » ^knots  and  „e^Le?e  oTy 
«  knots ^  at0rseaSaC„daS25  kenotsT^  «  speeds  «*« 

obstacles  of  up  to  four*  feef'ln^e^ht.' 

shore  vehicle  that  can  transport  60  tons  up  to  50  miles  Unlike 
conventions!  craft,  the  LCAC  is  not  affected  by  tides,  « 
df?th'  Obstacles,  beach  slopes,  torpedoes,  or  most 

capable  vehicle  has  revolutionized  the  design 
of  military  amphibious  operations.  Similarities  and  differences 

LCAC  can^bnenfLCtCS  rotary-win9  aircraft.  Similarities  include 
LCAC  capability  for  three-axis  motion  (including  lateral  traverse) 

speed  beyond  that  of  surface  craft,  nature  of  operating  control 
(yo  e,  collective,  and  foot  controls),  high-performance  propulsion 
systems  (four  gas  turbines),  and  advanced  navigation  and 
engineering  displays.  Differences  include  less  operating  altitude 
-.-(four  feet  rather  than  thousands)  and  speed  (40  versus  160  knots) 
compared  to  helicopters,  fully  shrouded  rotors  that  allow  closer 
approaches  to  objects,  and  a  crew  that  is  larger  and  more 
interdependent  than  that  of  a  helicopter,  but  lacking  the 
capability  for  one-man  craft  operation.  LCAC  operating 

characteristics  and  technology  have  created  unique  mission 
conditions  and  performance  requirements  for  crew  personnel. 

The  operational  requirements  of  this  sophisticated 
amphibian  and  the  premium  upon  retention  of  highly  trained  crew 
personnel  led  to  the  establishment  of  specific  (interim)  physical 
standards  for  LCAC  crew.  The  development  of  permanent  medical 
standards  is  underway.  Due  to  the  craft's  numerous  operational 
similarities  to  aircraft,  U.S.  Navy  aviation  medical  selection 
cntenae  were  used  as  the  basis  for  the  interim  medical  standards. 
During  the  standards  development  process,  significant  consideration 
was  given  to  minimum  visual  acuity  limits,  particularly  for  craft 
operators.  This  emphasis  came  partly  from  aviation  community 

input,  and  partly  from  those  involved  experienced  'in  LCAC 
operations  and  familiar  with  the  visual  needs  of  craft  personnel. 

Vi si on/visibility ,  total  workload,  and  cockpit  resource 
management  are  considered  to  be  key  interrelated  human  factors 
issues.  Navigation  and  effective  LCAC  craft  operation  are  highly 
upon  visual  cues.  Visibility  from  these  craft  when 
operating  on  air  cushion  is  almost  constantly  degraded  by  water 

of^iMUtv indon°cclfusion  the  craft  structure  itself.  In  terms 

t  visibility,  operating  an  LCAC  has  been  compared  to  "driving  an 
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automobile  in  a  rainstorm".  Craft  approaches  to  the  beach  and  to 
the  "well  deck"  (operations  bay)  of  the  support  ship  are  where  the 
highest  workloads  and  potential  for  error  occur.  Identifying  the 
beach  landing  site  and  maneuvering  while  ashore  is  a  group 
activity.  Locating  beach  obstacles,  depressions,  etc.  include 
constant  visual  searches  performed  while  moving  at  relatively  rapid 
surface  speeds.  There  is  a  perceived  increase  in  cockpit  workload 
due  to  further  visibility  decrements  during  nighttime  operations, 
which  comprise  a  significant  percentage  of  LCAC  missions.  Beach 
approaches  during  night  operations  take  on  a  special  quality  of 
crew  vigilance,  as  does  the  avoidance  of  surface  obstacles  en  route 
to  these  night  landings.  Currently  available  night  vision  devices 
have  been  minimally  effective  in  improving  night  visibility  for 
craft  operators.  Visibility  does  appear  to  be  a  primary 
performance  limiting  factor  for  LCAC  crews.  Degraded  visibility 
increases  total  cockpit  workload  and  is  an  important  issue  in 
cockpit  resource  management  for  this  highly  interdependent  team. 
Other  workload  issues,  such  as  the  fatigue  resulting  from  fast- 
paced  turnaround  missions,  are  additive  to  the  demands  of  vision 
and  visibility.  Whether  current  minimum  visual  acuity  standards 
for  LCAC  candidates  are  optimal  or  excessively  selective  in  light 
of  diminished  operational  visibility  is  a  question  currently  under 
investigation . 

Visibility  issues  for  LCAC  personnel  to  be  developed  include 
the  following: 

1.  The  collection  of  objective  vision  and  visibility  data 
under  real  or  simulated  mission  conditions,  and  relating  that 
to  task  performance.  Current  recommendations  are  based  on 
subjective  observations,  and  are  not  quantitated. 

2.  Training  techniques  to  enhance  individual  processing  of 
degraded  and  night  visual  cues.  Although  selection  criteria 
have  been  adopted  to  minimize  the  possibility  of  visual  errors 
in  crew  personnel,  the  issue  of  possible  enhancement  of 
individual  capability  has  not  been  addressed. 

3.  Identifying  an  effective  means  of  screening  LCAC 
candidates  for  their  relative  ability  to  recognize  degraded 
visual  cues.  Current  night  vision  screening  for  example,  is 
limited  to  the  history  of  difficulty  with  night  vision. 

4.  Possibilities  of  improved  night  vision  devices.  LCAC 
personnel  who  have  used  the  night  vision  devices  currently 
available  to  these  units  have  experienced  a  number  of 
difficulties  with  them  related  to  loss  of  peripheral  vision, 
instrument  glare,  etc.  Different  personal  devices,  or  a 
different  system  such  as  craft-mounted  forward-looking 
infrared  (FLIR)  have  been  suggested. 

5.  Setting  optimal  visual  acuity  standards  for  LCAC  crew 
personnel.  This  is  one  of  the  tasks  involved  in  the  current 
development  of  the  permanent  medical  standards. 
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CONTROL  AND  USE  OF  COLOR  IN  FLIGHT  SIMULATORS 
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display  color,' “thich^g  “en  tSTSSlif  0“/"*,°" 

concerned  with  problems  rating  to  the  use  V't  b*®: n 

Sr  °f  "y  tiM  5abo°u?ecuUrreenf  SSJSS 

displays^  a^chapter  ^itteffTr  f  forthcomTn^^ok^  ES? 

ptical  Displays,  edited  by  M.  A.  Karim.  That  chapter  is  too  long 
to  review  here;  it  is  based  on  an  extensive  search  o?  tSl 
literature  and  5  years  of  work  with  our  own  laboratory  displays 
control1  3  nuiTshe1}'  Xt  reports  the  prevailing  consensu? that  color 
St  J “ake  us®  of  a  common'  internationally  accepted 
reference  system,  namely,  one  of  the  descriptive  color  systems 
adopted  by  the  CIE  and  based  on  XYZ  tristimulus  values.  Y 

in„TnTnJr1i?ram^inoFii9Ure- 1  Was  adaPted  from  Roy  Hall  ’  s  1988  book, 
Illumination — and — Color — in — Cgmmfeer-Generated  Tmaopry  and  it 

reflects  this  consensus.  Although  "Current  Practice"  still  relies 
upon  RGB  computation  and  storage  of  color  data,  everyone  should  now 
recognl2e  that  RGB  odor  differs  trom  one  display  device  ?o 
another.  in  other  words,  RGB  color  is  device-ri«>p<j>nrf<>r.i-  For 

adequate  control,  the  "Ideal  Methodology"  requires  that  color  data 
from  whatever  source — be  transformed  to  a  CIE  XYZ-based  color 


Ideal  Methodology 


Current  Practice 


Figure  1. 
97 


&£££?  tFSTESStTS?  R^td’?aitrTUltin9  COlor  data  ba 

possible  moment  beforl  dTspla?  S  laSt 

daball  whlch  .Ih,wi11  not  *“*y  to  discuss,  except  to  urge  tbat°a» 

should,, rtPn°onS ^  f as  !°on  as  possible,  the  simulator  community 
should  adopt  Illumination  &  Reflectance  Data"  as  the  orincioal 

source  of  color  information  going  into  flight  simulation  databases. 

rnl  ®£  US  sti11  stuck.  with  iaage  generators  that  compute 

.ln.RGB  space,  there  is  a  practical  approximation  to  the 

in  an  '  We  can  adoP *  J  color-editing  system  which  works 

.a”  XYZ -based  space  and  which  computes  the  corresponding  RGI 

+ fr?®  ,lnformation  about  our  display  device's  cold 
output  characteristics.  Corporations  in  the  color  reproductior 
business  are  beginning  to  present  such  color  editors  on  the  market; 

SvsteFtT^vrM^1^^^^16 ,  1S.maf^eting  the  Tektronix  Color  Management 
^  for  use  in  the  reproduction  of  computer-graphics 

images  on  color  printers. 


Figure  2  shows  an  on-screen  display  from  our  laboratory ' £ 
Color  Modeling  Workstation,  still  under  development,  which  wilt 
enable  us  to  specify  the  XYZ-based  colors  in  each  of  our  mam 
databases  in  RGB  digital  codes  tailored  specifically  to  each  of  oui 
severa 1  di splay_dev ices .  This  color-editing  system,  like  TekCMS1" 
makes  use  of  an  approximately  uniform  chromaticity  space  callec 
CIELUV,  which  was  recommended  by  the  CIE  in  1976  as  one  of  two  sucl 
spaces  (the  other  one  is  called  CIELAB)  which  may  be  used  to  sho\ 
the  relative  positions  of  colors  in  3  dimensions.  Those  of  yoi 
interested  in  the  Color  Modeling  Workstation  will  have  an 


Figure  2. 
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information  which  ^t' ^i^lay^®”10011  ask  questions  about  the 

confident  thatPthe  ^lor  output  ****  aolved'  1  can  be 

is — will  correspond  Dhvsirai?,,  +■?.  i-J*  ^?p.lay  device — whatever  it 
been  specified.  I  vinASAAl  etoverifvSff?  Colors  Which  hava 
setting  up  whatever  photometer  or  radiomJ?J" S  ?orresP.ondence  by 
taking  measurements.  Will  t  fhon  radl°aeter  is  available  and 

dif?1?y  which  results?  Not  necessarilv  *P1?I  the  full~c°lor 

artistry  and  technical  proficiency  of  th^.*  l0t  deP®nds  upon  the 
database.  This  "technical  colfea9ue  who  modeled  the 

;  increasingly,  in  the  coming  yLrs  bv^d  should  be  aided 
-investigation  of  color  '  by  dev®lopments  in  the 

which  gave  us  chromaticitJediagr^1bLidr^nr c  1*°™  ^^F^^etry, 
and  the  CIELUV/CIELAB  3D  color  stw k  f  color“B‘atching  data 
data.  The  investigation  of  color^ntl^  d  °n  c?lor“dif ference 
psychological  quantities  such  as  t£i A^nesA9"  drea  sca  1  iag  of 
colorfulness.  The  expected  product  vilirtiAAi  lightness,  and 
Of  human  color  perception-  t™  Lw 11  .  ,  more  cm»Plete  model 
proposed  and  are  cont  inwall  v  be  inn  ?  ”°d?ls  have  already  been 
demonstrations  illustrating  the  di^fer^1Se<H  Jnd  evaluated*  Some 
color  appearance  will  a"d 

been  aware  of  ^ol or  Appearance  rcowijAf!A9uffPhiC  industry  have 
have  solved  some  of  thesJ  i  for  40  or  50  years-  They 

the  sensitivity  of  their  color  fi3m«  ****'  successfully  by  modifying 
color  appearance  problems  that  aieAathlrAiv to;.  dlsPlay®  have  some 
-the  early  days  of  color  photography  AhS  thA™,°??  encountered  in 
viewed  as  color  slides  projected* wAth  t^eAughA  InA  SSSS5 

photogAphicAndAstVAbAcause0^  awASmAAi!  T  A,  thf 

lSm?AnceUnnor gAater^SAAbAAAbA  niT*1* A"®'  °l)UCMaxiSL 

AAAcAAoArfo? 

sfc  lssrrL,i7  o°  tin %  Ast  I"1'3 1  *  ii^-d^ 

normally  have  L:D  ritios  of  100:1  or  bett«  °UAaain''i?h0''  scen?s 

ob?ec?srf  Af  A°?L?ted1??S1'dWh?Se-C°ntraSt'  ia  5®or  io-l  forAosI 
in  a  dart  snrLnn1  ed  11313  of  Vlew'  PerhaPs  60  by  140  degrees, 

image-generator 

resolution  limited  by  imagl-grneritoJ  ^ ?patlal  and  temporal 
When  out-the-window  sLomntT  generator  and  display  characteristics, 

weather  conSitions  InTtL^  res?lutio”  limited  by  time  of  day, 
to  deal  with  soatial  hUIn^-Ylsual  system.  [Photography  had 

sampling.]  P  amplmg  (film  gram)  but  not  with  temporal 
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Low  luminance  comes  at  the  head  of  the  list,  because  it  is  the 
source  of  several  color  appearance  problems.  The  general  level  of 
ad^lng  has  a  profound  effect  on  perceived  brightness— 

°n  per;ceived  contrast— as  Jameson  and  Hurvic*  pointed 
out  m  1961  m  an  elegant  little  article  in  Science 

average  iuminance  in  the  visual  field  goes  up,  the  whitls  nS?  only 
get  whiter  but  the  blacks  get  blacker;  the  scale  of  perceived 
il  expanded'  making  the  light/dark  contrast  more 
For,°?r  simulator  displays  (and  for  color 
slides)  this  finding  explains  a  major  problem.  Because  our 

WS  if  possible,  exaggerate  the  physical 

luminance  difference  between  light  and  dark  areas,  making  them 
relativeiy  more  different  than  they  are  in  the  “real  scene,"  in 
order  to  capture  the  same  apparent  contrast. 


Reduced  luminance  also  means  reduced  'colorfulness',  a  term 
that  is  technically  not  the  same  as  either  'saturation'  or  'chroma' 
but  that  signifies,  the  richness  or  vividness  of  the  hues  in  a 
scene.  A  dark  surround  also  serves  to  reduce  colorfulness.  In  the 
photographic  industry,  films  have  been  devised  which  heighten  color 
beyond  the  level  of  mere  duplication  of  the  physical  chromaticity 
in  the  scene.  Then,  when  projected  in  a  dark  surround  at  low 
luminance,  the  colors  appear  approximately  as  'colorful*  as  in  the 
normal  daylight  scene. 


At  low  luminance  levels,  and  when  using  self-luminous  display 
colors,  the  apparent  brightness  of  colors  will  require  special 
attention.  Self-luminous  displays  can  produce  higher  relative 
luminances  for  reds,  magentas,  and  blues  than  will  ever  occur  in 
natural  scenes.  In  natural  scenes,  the  most  saturated  colors  occur 
in  low  reflectance  samples  viewed  in  bright  illumination.  Although 
the  amounts  of  light  emitted  by  blue  or  red  phosphors  of  a  CRT  are 
much  lower  than  the  amount  emitted  by  the  green  phosphor,  these 
amounts  are  still  enough  to  exceed  the  relative  luminance  of  a 
saturated  blue  or  red  surface  reflecting  natural  light. 

If  the  display  is  operating  at  dome  display  luminance,  the 
light  level  is  also  mesopic,  and  the  rods  are  making  a  relatively 
large  contribution  to  apparent  brightness.  The  rod  contribution 
will  exaggerate  the  apparent  brightness  of  the  blues,  while  the 
cone  contribution  is  still  sufficient  to  make  saturated  reds  appear 
luminous.  These  facts  mean  that  self-luminous  displays  make  it 
easily  possible  to  over-exploit  colors  near  red  and  blue. 


.  •  .?ur.  investi9ations  now  deal  increasingly  with  methods  of 
heightening  contrast  and  colorfulness  in  the  large— screen  displays 
which  you  will  see  at  Williams.  Some  of  these  employ  light -valve 
projectors  while  others  use  projection  CRTs.  The  color  outputs  of 
these  two  types  of  projector  are  radically  different.  Their  color 
gamuts  are  compared  in  the  two  insets  at  the  top  of  Figure  2  (light 
valve  on  the  left,  CRT  on  the  right).  The  vertical  axis  in  Figure 
3  shows  the  L*  (brightness)  dimension  of  these  outputs.  Simply 
making  maximal  use  of  these  very  different  gamuts  requires  color¬ 
processing  through  something  like  the  Color  Modeling  Workstation. 

ara;®e  / r.oln  texturing  and  anti-aliasing  algorithms 
which  are  still  applied  in  RGB  space. 
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Figure  3. 


devic^11„i?ialprobibly0fret^re°1!nnPOt^tial  °f  existi"9  displa; 

systems.  As  these  innovations  develop  ove?  tine 

help  buyers  and  ncprc  n-e  e4»„i.4.'  *  x  ‘~Line'  our  task  is  tc 

atandards  in  choosing  and  operating ‘SieSfdevLe^15'  appropriats 


DETERMINANTS  AND  CONSEQUENCES  OF  SMOOTH  PURSUIT 


Julie  Mapes  Lindholm 
University  of  Dayton  Research  Institute 
Armstrong  Laboratory,  Williams  AFB,  Arizona 


The  visual  systems  of  most  flight  simulators  consist  of  an 
image  generator  (IG)  and  an  electro-optical  display  device.  The  IG 
samples,  in  both  space  and  time,  the  distribution  of  light  that 
would  be  visible  through  a  "window"  orthogonal  to  the  line  of  sight 
and  in  front  of  an  observer  who  moves  through  a  data-  base  model  of 
some  region  of  the  world.  These  digital  values  are  converted  to  an 
analog  signal  which  modulates  the  output  of  the  display  device. 
The  resulting  visual  display  is  meant  to  reproduce,  as  closely  as 
possible,  the  original  (if  hypothetical)  space-time  image. 

According  to  sampling  theory,  the  Fourier  transform  of  a 
sampled  version  of  a  continuous  function  is  a  periodic  replication 
of  the  transform  of  the  original  function,  with  the  replicas 
separated  by  the  sampling  rate(s) .  Thus,  if  the  continuous  image 
of  an  IG,  f (x,y,t)  ,  is  sampled  in  space  with  intervals  of  Ax  and  Ay 
and  in  time  with  an  interval  of  At,  then  the  replicas  will  be 
separated  in  the  fx,fy,ft  frequency  space  by  the  sampling  rates 
1/Ax,  1/Ay,  1/At,  respectively. 

A  continuous  function  is  bandlimited  if  its  Fourier  transform 
is  zero  outside  some  bounded  region  (the  region  of  support)  in  the 
frequency  space.  Sampling  a  bandlimited  function  at  greater  than 
twice  its  maximum  frequencies,  that  is,  at  greater  than  its  Nyguist 
rates,  ensures  that  none  of  the  replicas  in  the  sampled  function 
will  intrude  into  the  region  of  support  of  the  original  function. 
The  original  function  can  then  be  recovered  from  the  sampled 
function  by  a  lowpass  filter  which  completely  attenuates  the 
replicas  introduced  by  sampling  and  passes  the  baseband  (i.e., 
original)  spectrum  without  attenuation. 

If  a  function  is  sampled  at  less  than  its  Nyquist  rate  for  a 
particular  dimension,  frequency  components  representing  the 
original  function  will  extend  above  and  corresponding  components  of 
the  appropriately  spaced  replicas  will  extend  below  half  the 
sampling  rate.  This  phenomenon  is  known  as  aliasing.  When 
aliasing  occurs,  the  original  function  cannot  be  recovered  by 
subjecting  the  sampled  function  to  a  low-pass  filter  with  cut-off 
frequencies  equal  to  half  the  sampling  rates:  The  high-frequencies 
in  the  original  function  will  be  lost  and  aliased  frequencies  will 
distort  the  function  that  is  passed.  To  prevent  aliasing,  the 
original  function  must  be  filtered  before  it  is  sampled  to  ensure 
that  it  does  not  contain  frequencies  higher  than  half  the  sampling 
rates.  Appropriate  filtering  during  reconstruction  will  then 
result  in  a  lower-resolution  but  otherwise  distortion-free  copy  of 
the  original  function. 
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.  To  reduce  aliasing,  the  more  advanced 
algorithms  that  serve  as  lowpass  (albeit 
presampling  filters.  However,  except  for 
these  filters  have  on  the  temporal -frequency 
current  IG  system  have  not  implemented  any 
temporal  aliasing.  * 


IGs  have  implemented 
nonoptimal)  spatial 
the  indirect  effects 
content  of  the  image, 
procedures  to  reduce 


^?^erences  a^-so  exist  in  the  spatial  and  tennorai 

diIt?ibi?ionfoSfttnhearedlf=tPlay  deyic!S-  For  eX£“Ple.  the  intensity 
aiscriourion  of  the  electron  spot  of  a  CRT  serves  as  a 

spatial  postsampling  filter.  In  contrast,  very  little  temporal 

dicayrto9lO^Sofrthifrd  ^  CUrfent  C?T  Phosphors,  which  typically 
decay  to  10%  of  their  maximum  intensity  in  less  than  a  millisecond. 

Computer  generated  display  images  are  thus  characterized  not 
aliasad  sPat 1 o tensor a 1  frequency  components,  due  to  the 
fi-an  temPoral  presampling  filter,  but  also  by 

components  with  temporal  frequencies  greater  than  half  the  temporal 
sampling  rate,  due  to  the  lack  of  an  adequate  temporal  postsampling 
filter.  The  inadequacy  of  the  temporal  postsampling  filter  is 
usualiy  not  problematic,  however,  because  the  human  visual  system, 
which  is  sensitive  to  only  a  limited  range  of  spatiotemporal 
frequencies,  functions  as  a  second  postsampling  filter.  In  this 
regard,  Watson,  Ahumada,  and  Farrell  (1986)  proposed  that  an 
observer  will  be  unable  to  distinguish  between  a  continuous  image 
and  a  temporally-sampled  image  if  the  frequencies  in  the  replicas 
of  the  sampled  image  fall  outside  the  "window  of  visibility,"  which 
they  defined  as  a  rectangular  frequency  space  bounded  by  the 
spatial-  and  temporal-frequency  limits  of  the  human  visual  system. 

Thus,  if  a  continuous  image  were  subjected  to  temporal  and 
spatial  presampling  filters  that  eliminated  (only  those) 
frequencies  to  which  the  human  visual  system  is  not  sensitive  and 
then  sampied  at  frequencies  in  excess  of  its  Nyquist  rates  (which 
in  this  case,  would  also  be  twice  the  spatial-  and  temporal- 
frequency  limits  of  the  visual  system) ,  then  the  resulting  display 

image  should  be  perceptually  equivalent  to  the  original,  unfiltered 
image. 

thf  J?bserv®.r's  eyes  ffiove'  however,  the  temporal  frequency 
content  of  the  retinal  image  will  not  match  that  of  the  display 
image.  Therefore,  a  temporal  presampling  filter  based  on  the 

c°n1Ter}t  of  the  original  image  is  appropriate  only  if  the 
observer  maintains  a  constant  fixation.  This  is  unlikely  under 

condltlons*  Smooth  pursuit  eye  movements  are  elicited 
y  sampled  versions  of  an  object  moving  at  a  constant  velocity. 
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even  when  the  spectral  replicas  contain  spatiotemporal  frequencies 
tw® .Vlsual  system  is  highly  sensitive.  Indeed,  while  the 
work  of  Watson  et  al.  (1986)  suggests  that  the  perceptual 

=t^that  ^terPret  th®  retinal  image  can  distinguish  between 
sampled  and  continuous  motion  when  frequencies  in  the  sampling- 
induced  replicas  are  visible,  our  research  indicates  that  the 
oculomotor  system  is  insensitive  to  this  information.  Stated  more 
positively,  the  oculomotor  system  can  extract  the  constant  velocity 
line  from  quite  complex  spectra. 


Figure  la  illustrates  the  spatiotemporal-frequency  spectrum  of 
a  continuous  image  of  a  vertical  bar  moving  from  left  to  right  at 
a  constant  velocity  v.  The  region  of  support  of  the  spectrum  has 
a  slope  of  -1/v?  its  sinc-like  cross  section  reflects  the  width  of 
the  bar.  Figure  lb-  illustrates  the  spectrum  of  a  sampled  version 
°f  the  specified  image.  Note  that  the  original  spectrum  is 
replicated  at  multiples  of  the  sampling  rate,  1/At. 

If  the  bar  in  the  image  is  taken  to  subtend  a  visual  angle  of 
12.5  arc  min  and  to  move  at  10  deg/s,  then  Figure  lb  represents  a 
sampling  rate  of  60  Hz  and  the  displayed  spectra  (Figures  la  &  lb) 
each  cover  ±  120  Hz  horizontally  and  ±  12  cycles/deg  vertically. 
Clearly,  for  this  velocity,  the  spectral  replicas  introduced  by  a 
60  Hz  sampling  rate  would  contain  spatiotemporal  frequencies  that 
are  well  within  the  passband  of  the  human  visual  system.  Moreover, 
many  spatiotemporal  frequencies  in  the  original  spectrum  would  not 
be  visible. 


If  the  velocity  of  the  eyes  were  exactly  10  deg/s,  however, 
then  the  region  of  support  of  the  retinal  image  (for  Figure  lb) 
would  consist  of  vertical  lines  at  multiples  of  the  sampling  rate 
(Hsu,  1985) .  Each  spatial  frequency  in  the  baseband  would  be 
associated  with  a  temporal  frequency  of  zero.  The  replicas 
introduced  by  sampling  would  be  visible  (and  then  as  flicker)  only 
if  the  observer  were  sensitive  to  a  temporal  frequency  of  60  Hz. 

Clearly,  the  spatiotemporal  frequency  content  of  the  retinal 
image  that  results  from  a  given  display  image  varies  dramatically 
with  the  oculomotor  behavior  of  the  observer.  We  are  currently 
investigating  the  determinants  of  that  behavior  and  its  perceptual 
consequences . 


example ,  we  have  found  that  smooth  pursuit  eye  movements 
of  an  approximately  constant  velocity  are  sometimes  elicited  by 
sampled  (and  probably  continuous)  versions  of  images  with 
inconstant  velocity  profiles.  This  property  of  the  oculomotor 
system  is  of  particular  importance  for  display  images  created  by 
simulators  m  which  the  update  rate  of  the  IG  is  less  than  the 
refresh  rate  of  the  display  device.  In  such  images,  a 
representation  of  a  moving  target  is  presented  r  times  at  every 
sampled  position,  where  r  is  the  ratio  of  the  refresh  rate  to  the 
update  rate.  Thus,  if  the  continuous  image  is  moving  at  a  constant 
velocity  v,  the  displacement  of  the  display  image  will  be  in  accord 
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of“v2r^er0piriolLZer°  f°r  1  -  1  and  a  velocity  of  a  for  one  out 
such  ieage^ew^^fcl3^nm^*rtllft-n*!??,^er®epttlal  conseQuer,ces  of 

*  the  duration  ^rtS^^e^StS?Kende?t  *««or. ’including 

m  general,  h^e^,^?arg!TS^S  S*-W^»ty  ??  the  tar9et- 
the  motion  sequence  is  short  ^  ^  motion  only  when 

-  maintain  a  BuZjj  t&SSL  ^ 016  °baa.tver  attempts  to 

track  the  target  and  giveS  iiJ^d^L^r,  ,  ls  encouraged  to 
/  approximates  that  of  the  continuoo«l£«^'  (?.  «  1!  ^?“ 

s&Ja  “SS 

movement.  11  alS°  be  ^haracte^iTe?  by  flSe^or  ^inltrnli 

ifgS:  ?is£i?x  ™?le?n 

.  ?  Jii-IS-.SM  3-SS 

] mPiing1r1at:e*  Although  these  lines  all  have  a  slope  of  -!/v  the? 

constant  veloH?  ^  Sa*e  sPablal  spectrum.  The  Ipectrum  of  the 
1  J.  15  rePUcated  at  even-numbered  multiples  of 

the  sampUng  rate  (i.e.,  at  multiples  of  the  display  rate)  /whereas 
different  spectarum  is  replieated  at  odd  numbered  multiples  of  the 
IndPiing  rrate*  v^®ltb®r  sp^ial  «|>ectrum  matches  that  inPFigures  la 
Part^l^r,  the  spatial  fprm  defined  by  the  Constant 
locity  line  in  Figure  1C  is  not  a  single  vertical  bar.  Rather 
as  demonstrated  by  inverse  Fourier  transforms  of  such  spectra,  it 

is  the  form  that  would  be  perceived  during  smooth  pursuit  eye 
movements .  ■* 
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Figure  1.  Image  Spectra 


of  advanced  imaging  sensors,  pilots  of  both  rotorcraft  and 

vp^’TJ?  frCrSft  CTi°W  COnduct  that  were  not  possible  just  a  few 

years  ago  In  general,  these  sensors  can  be  viewed  as  extensions  to  a  pilot’s  own 

wSpSyS^m'  5s aUo!Lt^e  to  ®^ely  fly  complete  missions  at  times 
when  environmental  conditions  (e.g.,  darkness,  dust,  smoke)  would  preclude 

?w!°r  ^SS1°n  completion  with  unaided  vision.  One  class  of  imaging  semors 
that  has  been  used  extensively  by  pilots  for  targeting,  navigation, and  flight 
control  purposes  are  thermal  imaging  (infrared  imagery)  systems.  In  general 
thermal  imaging  sensors  are  sensitive  to  thermal  radiation  in  the  infrared  range 

u-  v  spectrum  (3-6  microns  or  8-14  microns).  (Visible  light  to 

which  the  human  eye  is  sensitive,  is  in  the  range  of  0.4  to  0.7  microns  ) 


A  thermal  sensor  creates  a  visual  scene  on  a  cathode-ray  tube  (CRT)  that 
can  be  mounted  either  on  the  cockpit  panel  or  the  pilot's  helmet.  The  visual  scene 
provided  by  the  sensor  is  monochrome  and  appears  to  be  similar  to  black  and 
white  television  (TV)  or  reversed-video  (i.e.,  phase  inverted)  black  and  white  TV 
However,  despite  the  overall  appearance  of  similarity  to  TV  images,  there  are 
important  differences.  An  important  qualitative  difference  between  thermal 
imagery  (TI)  and  TV  or  unaided  vision  occurs  as  a  direct  result  of  the  image's 
source;  The  distribution  of  gray  shades  in  TI  represents  relative  temperature 
differences,  rather  than  brightness  and  reflectance  differences.  Compared  to  TV 
images  or  directly-viewed  visual  scenes,  TI  has  the  following  properties:  (1)  Heat- 
emitting  objects  generally  have  higher  contrast  with  the  background;  (2) 
Shadowing/shading  information  may  be  absent;  (3)  Sensor  polarity  settings  (i.e., 
the  assignment  of  white  or  black:  to  hot)  may  lead  to  perceptual  errors;  and  (4)  A* 
given  object  may  appear  quite  different  when  viewed  under  different 
environmental  conditions  (e.g.,  time  of  day,  yearly  season,  humidity,  ambient 
temperature).  These  characteristics  of  thermal  imagery  directly  impact  flight 
control  and  navigation,  particularly  at  veiy  low  altitudes:  (1)  Pilot  workload  is 
generally  higher  (Hart  &  Brickner,  1989);  (2)  Object  distances  may  be  inaccurately 
estimated  (Hart  &  Brickner,  1989),  (Hale  &  Piceione,  1989);  (3)  The  horizon  line 
may  be  indistinct  (Bohm,  1985);  and  (4)  Specific  objects  in  the  environment  may 
change  luminance  levels  drastically  as  a  function  of  time  of  day  (Berrv  Dver 
Park,  Sellers  &  Telton,  1984).  .  *  r 


A  variety  of  studies  have  been  completed  at  the  NASA  Ames  Research 
Center  over  the  past  few  years  investigating  pilots'  ability  to  use  infrared  imagery 
lor  flight  navigation,  orientation  and  flight  control.  The  following  is  a  brief 
description  of  a  few  of  those  studies. 
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1) 

An  experiment  by  Brickner  and  Staveland  (1989)  investigated  neonle’s 
^ taxgets  usin&  ^  or  TI  imagery  rSmied^ 

SoSsseTt^t  h attempted  to  ^etenBine  underi^^visimf  ^d 

(TV  hJTBnS  T  When  images  derived  from  reflected  visible 

nwSmfV  i^reft  Visi0n')  °r  enu.tted  thermal  radiation  (TI).  Targets  induded 
navigational  features,  such  as  rivers  and  canyons,  as  well  as  more  •’traditional- 
targets  such  as  vehicles  and  runways.  TV  and  TI  imagery  were  recorded 
simultaneously  during  two  helicopter  flights.  Flight  tapes  were  edited  into  21 
dynamic  segments  each  of  which  contained  a  specific  target.  Subjects  viewed  onlv 
one  type  of  sensor  imagery  (TV  or  TI)  on  a  given  trial.  Prior  to  eachtrial,  the 
experimenter  told  the  subject  which  target  was  to  be  located  and  recognized  on 
that  trial.  Tune  to  identify  a  target,  measured  from  the  point  at  which  it  first 
became  visible  on  the  screen,  was  recorded.  The  results  showed  that  for  natural 
targets  (e.g.,  nver,  canyon)  recognition  time  for  TV  images  was  faster  than  when 
the  identical  targets  were  viewed  using  TI.  Conversely,  man-made  targets  (e  g 
road,  tower)  were  recognized  more  quickly  with  TI  than  TV.  The  results  were  ’ 
interpreted  as  suggesting  that,  for  natural  targets,  TI  representations  did  not 
correspond  to  the  subjects’  expectation  or  cognitive  prototypes  (Posner  &  Keele, 
1968).  That  is,  for  natural  targets,  the  TV  targets  looked  as  the  subjects  expected 
but  the  TI  targets  did  not. 

Infrared  Imagery  Interpretation  (Expt.  2) 

,innmA  follow-up  study  was  conducted  by  Foyle,  Brickner,  Staveland  and  Sanford 
(1990)  using  the  same  general  experimental  procedure  as  above  but  with  more  test 
items.  In  order  to  expand  upon  the  results  of  Brickner  and  Staveland  (1989), 
three  categories  of  targets  were  defined:  (1)  Naturally-occurring  terrain  features; 
(2)  Stationary  non-terrain  targets;  and,  (3)  Moving  non-terrain  targets.  As 
discussed  above,  Brickner  and  Staveland  (1989)  found  that  target  recognition  was 
faster  for  man-made  targets  with  TI  than  with  TV.  The  reverse  was  true  for 
natural  (terrain-type)  targets:  TV  yielded  faster  recognition  times  thaw  did  TI. 

The  results  of  this  study  replicated  those  findings.  Type  of  target  strongly 
influenced  recognition  time.  For  both  categories  of  non- terrain  targets 
recognition  times  with  TI  were  faster  than  when  those  targets  were  viewed  with 
IV.  I  he  opposite  held  for  terrain  features,  with  TV  yielding  much  faster 
recognition  times  (this  can  be  seen  subjectively  in  Figure  1).  As  ggplainod  by 
Brickner  and  Staveland  (1989),  this  may  have  occurred  as  a  result  of  a  mismatch 
between  the  cognitive  mental  prototype  (the  expected  appearance  of  the  target)  and 
the  target  s  actual  appearance  on  the  TI  display.  For  terrain  features,  targets 
viewed  with  TV  may  have  matched  more  closely  the  subject's  mental  prototype 
than  did  targets  viewed  with  TI.  ^ 

Results  from  a  display  parameter  analysis  supported  the  hypothesis  that 
performance  with  TI  terrain  targets  was  influenced  more  strongly  by  cognitive 
factors  (e.g.,  mental  prototype,  expectation)  than  was  performance  with  TV 
terrain  targets.  In  order  to  determine  the  relationship  between  display 
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m  which  tai^t  &nalysis  was  completed 

deviation,  and  ******* 

tunes.  For  non-terrain  targets,  there  was  I  to  predict  recognition 

correlation.  For  terrain  ^statistically  significant 

nonsignificant  That  is  ’  e  corfelation  was  much  smaller  and 

SS,  S ^  times  For  non- 

terrain  targets  depends  on  display parmiitera.rfrfP®'®  ^trecognition  of  non¬ 
targets  depends  niora  on  cognate  of  terrain 

first  ^i^hw^lSrb^l^TStage “Ofielof object identification.  The 

formSres  arSSd^^Zi1^  “  and 

in  which  these  object  component  f  ?uhl?her‘lev1el  cognitive  process 

representation  of  ^eT^  ^  ^is^ood 

* 

present  study  in  tenns  of  thia  modal^S  igga**, resnl.ts  of  the 

sT 

targets  should  have  been  predictable  fora  the  display  parameters  as  well 
However  they  were  not.  An  explanation  ibr  this  failure  could  be  found  in  the 
second  stage  of  Biederman's  model:  With  terram^S^T tiFera  waTf  Mite  of 
and  o!!]aye  1  rfetS  match  the  subject's  mental  representations  These  data 
t?lT^ySeS  !fnd  “P*?  to  *"  hypothesis  that  the  ^cognition  ofnonte^n 
targets  depends  on  the  characteristics  of  the  human  visual  system  and  image 

display  parameters.  In  contrast,  recognition  of  terrain  targets  may  be  § 

determined  by  some  other  mechanism,  which  is  presumably,  cognitive. 

Related  Research 

“*on  10  the  above  work  on  interpreting  infrared  imagery,  other  on¬ 
going  research  issues  relevant  to  the  use  of  sensor  systems  in  flight  include* 
Distance  estimation  with  infrared  imagery  and  night-vision  goggles  (Foyle  & 
Kaiser  1991;  Kaiser  &  Foyle,  1991);  Flight  performance  as  a  function  of  sensor 

(Bnckner  &/oyle*  \9m>  and*  Attentional  issues  in  head-up  displays 
(HUD)  and  superimposed  symbology  (Foyle,  Sanford  &  McCann,  1991).  y 
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Figure  1.  Sample  objects  recognized  by  subjects.  Infrared  imagery  is  shown  in 
the  left  panels  and  television  imagery  on  the  right.  Top  panXsh^w  a  wTp^st 
(non-terrain  target)  and  bottom  panels  show  a  group  of  trees  (terrain  targets). 
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Abstract 


vision  #®viees  do  not  provide  sufficient  information 
for  safe  helicopter  control  m  certain  environments ,  such  as  the 
desert  or  water.  During  Operation  Desert  Shield/Desert  Storm, 
the  u.S.  Army  proposed- that  it  may  be  possible  to  augment  the 
available  information  by  projecting  a  pattern  of  lights  onto  the 
ground  forward  of  the  aircraft.  Presumably,  the  dynamic  patterns 
formed  by  the  cueing  lights  could  provide  sufficient  information 
for  obstacle  detection,  or  perhaps  even  could  serve  as  a  pseudo- 
flight  director.  We  have  tested  the  effectiveness  of  three  such 
configurations  under  two  levels  of  ambient  illumination  in  an 
active  flight-control  task. 


Five  experienced  general  aviation  pilots  served  as  subjects. 
Their  task  was  to  maintain  a  "safe  altitu<iew  while  flying  30 
simulated  flights  over  a  wireframe  grid  terrain  containing  a 
level  segment,  followed  by  an  uphill  or  downhill  slope.  Overall, 
the  results  indicate  that  certain  cueing*-, li^Jit  conf  igurations  can 
be  used  effectively  as  pseudo- flight  directors  without  impairing 
the  pilot's  use  of  available  natural  cues  in  the  scene.  Pilot 
errors  (indexed  by  the  duration  of  ground  contact)  were  reduced 
for  all  three  light  configurations  compared  to  performance 
expected  in  total  darkness.  Under  twilight  lighting  (dim 
terrain),  however,  only  two  configurations  produced  flight 
performance  comparable  to  a  control  condition.  A  second 
performance  measure  consisted  of  the  computation  of  flight-path 
Pr°fi-}-es  based  on  time— sampling  the  craft's  altitude  throughout 
the  simulated  flight.  When  these  profiles  were  compared,  the 
same  two  configurations  again  proved  to  be  equally  effective  as 
aids  in  altitude  control.  . 


As  operational  requirements  increase  the  need  for  helicopter 
pilots  to  fly  under  low-visibility  conditions,  so  too  does  the 
need  for  aids  to  insure  the  safety  of  these  missions.  Our 
results  indicate  that  certain  relatively  low  cost  solutions  can 
be  used  effectively  to  augment  the  information  available  in  a 
limited-feature  terrain.  Future  research  on  the  use  of  cueing- 
light  configurations  should  consider  issues  related  to  their 
successful  impiementation,  including  field  calibration  and  pitch 
stabilization.  ^ 
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Jo  %  1  si  s  m^^01  °sy  a  p  pi  1  ed 

”3!  J  JTE  •*.*,  « 1 

the  following  example.  The  example  wIsTel’pcted^lr6'7’6"1'3  iS  described  in 
been  more  successful  than  most  in  flrriuin  e+ted  because  it  appears  to  have 
training  simulation  system^ Shlch  fill l 'IS  at  3"  definiti°^  of  a 

concept  development  process  beqan  with  the  iH*nt ? f?dS+"hen  de1lvered*  The 
be  trained  and  led  to  a  ore! iminJr!  •  f -tlfl -atlon  of  visua1  tasks  to 

requirements  for  the  visSal  simulatioS  systm  "  W1  quantlfled  Performance 

^ZarS'SS,=KS»-3a. 

Ionfi’del!re0in9:fhpeSCr1ibed  iS  V6ry  pragmatic  in  trying  to  establish  reasonable 
confidence  in  the  preliminary  system  design  without  attempting  to  resolve 

,  ^  conceivable  question.  It  was  also  forced  to  meet  stringent  budqet  and 

intPndld  Jonstraints.  The  example  system  has  been  built  and  validated  for  the 
intended  training  application. 
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A.  Aviation  Physiology  Laboratory 

rM^i?yonhcSSl  oo^ns^ri  Aeromedical  Research 
review.  Active  research  is  onaoina  in  both  th?Ni20r>Cerns  and  aeromedical  standards 

Sections,  in  the  Vision  Refe^rlhSectk)n  S®"Ce  and  the  Vision  Research 
recently  completed  or  current.  '  lowing  research  activities  are 

S?  IdarlJ  ■  °‘  Simula,ed  Alti,uda  on  tha  Visual  Field  of  Glaucoma  Patients  and 

that  is^sufbciem  'to^ause'dearadatlon^f  ^h^nn^6^  *ntra°cular  pressure  occurs 
field.  Pilots  with  glaucoma  TO/Dres2nfsr,eH»i’^f„i'f1'  and  detects  in  the  visual 
acceptable  visual  field  results  at  8?oun?lev?Tbut  exo^iencech®  theymay  present 
with  exposure  to  altitude  hypoxia  Renpatpri  *  chf?n9es  «"  visual  field 

accelerate  the  progression  of Pgteuconia  Pin  6  t0  h‘9h  a,titudes  may 

•  temporary  increase  in  field  loss  at  tvnir»i  fiil?h+P^f^e29ers  as  wel1  as  Pilots.  If  a 

.  would  represent  a  stress  of  the  visSTsystem^that’mkibt  £°Uld  56  demonstrated,  this 
in  visual  field  loss.  V  Tem  that  m,9b*  cause  a  permanent  increase 

State  University,  Colte^o? OptometrvWwasf^ Dprf™r^nJberS  fr°m  the  Northeastern 
and  elderly  subjects  at  an  atmosDherir  X°  assess  whether  glaucoma 

the  typical  flight  environment  (ie  1 0P(5Sf tf2»t/rnU-iTt,n  «the  h,0h  altitude  end  of 
compared  with  their  fieTIt  ground  lev^  ^  W'"  SUffer  temPorarV  scotomas 

6  younger  subjects  were  tested  glaucoma,  12  age-matched  normal,  and 

any  of  °t£  visuaf  fiewfwaV^^^  ?'1t°;°0°  effect  on 

witShUSoamCahar 

patients  from  flying  as  passengers  V  d  th  *  shou,d  discourage  glaucoma 
II*  The  Use  of  Contact  Lenses  in  the  Civil  Airman  Population. 

civil, anFpHo«al,oAsati^  SS^aTacS  rec^n®,  °ff  lenses  by 

certificates.  In  order  to  auide  ements  for  obtainmg  medical 

and  airmen  education safeiv  nS  decisions,  policy  changes 

active  airmen  who  wore  conta’ctTnses  aver®^1^^r9'ce^udd(v1 9W6^8^r,ormed  of 
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durinJ£S“^  by  1.4X 

fastest  in  first-class  airmen,  .b^2.o3?K^ta?^^ 

study  ^ricSerCTh??revaSe?are^ ‘Srttt^S^jlS'naS’lnSSsSd  feaes?^"0/^ 
class  airmen,  about  4X  faster  than  either  2nd^or  Jrddass  ,n  first' 

but  at  ?mSSM  dramatically, 

III.  Aphakia  and  Artificial  Lens  Implants  in  the  Civil  Airman  Population. 

The  FAA  allows  civil  airmen  with  aphakia  to  fly  with  waivered  certifiratP* 

arrTST  tW,tt  aphtkia  a0d  art,ficlal  ,ens  imP*ants  have  been  associated  with  hiqher 
accident  rates  when  compared  to  the  total  airman  population  in  two  prior  FAA 

clvi?  aiSrman  potp^abon  V  P"°'S  are  “mPris,n9  a  lar9er  Percentage  of  the  total 

a  ,  ,.9ur  curr®nt.  study  looks  at  civil  airmen  with  aphakia  and  intraocular  lens  (IOL) 
nomn^tL5SS0TCha  t0  ,aV,at,°"  accidents  from  1 982-85.  Accident  analysis  is  being 
!  L  The  P?v?,ence  f°r.  ^  aPhakia  and  IOL  airmen  increased  most  for 
bilateral  and  second  class  certificate  holders;  the  prevalence  of  aphakia  increased 

np0r^Hf0rT!Ta  eS  -2nd  the  rat®  for  l0L  increased  most  for  females  during  the  study 
period.  The  incidence  surprisingly  declined  in  both  pathology  categories  durinq  the 

hndingHnckIdeb6  StUdV  Pen°d'  Factors  that  cou,d  contr'bute  to  these  unexpected 


1) 

2) 

3) 

4) 

5) 


Self-selection  (voluntary  removal)  from  flight  status  by  airmen  with 
cataract  and  early  post-operative  aphakia; 

Reluctance  of  airmen  with  cataract  to  have  their  pathology  corrected 
with  surgery;  ay 

Incompatibility  of  modes  of  correction  or  complications  of  surgical 
procedures  with  certain  flight  operations; 

Vision  disability  from  aphakia  and  IOL;  and 

More  stringent  FAA  disqualification  criteria  being  initiated  durinq  the 
study  period.  a 


evaluate  these'trends^ op '°L  3,rmen  *  beinfl  planned  to  further 
IV.  Glare  Vision  Testing  in  the  Certification  of  Pilots. 

hoon  J„he  use  °J  9(are  testing  for  the  medical  certification  of  pilot  applicants  has 
been  recommended  by  several  independent  sources,  including  the  American  Medical 
ha?rpSf°onHa^>ihe  Nf^0.031  Academy  of  Sciences7  Institute  of  Medicine.  The  FAA 
f  ecLw,*h  medlc.a*  wa,vers  airmen  with  different  ophthalmic  conditions  and 
TKo^an  K-f^ICef '  yvhteh  ^ave  keen  associated  with  increased  glare  sensitivity 

The  applicability  of  glare  testing  to  aviation  has  not  been  established.  V 
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The  major  objectives  of  this  project  are  to: 

1 .  Identify  the  effect  of  glare  on  vision  performance  under  simulated  flight 
conditions  in  selected  visually  compromised  (e.g.,  aged,  cataract, 
aphakia,  IOL)  and  ophthalmologically  normal  test  subjects. 

2.  Assess  current  airman  vision  standards  and  certification  policy 
concerning  these  airmen; 

3.  Recommend  medical  standards  changes  for  these  vision  pathology 
categories;  and 

4.  Revise  educational  programs  and  develop  aeromedical  related  pamphlets 
for  flight  crew  personnel. 

An  evaluation  of  commercial  glare  test  devices  is  being  completed.  An 
evaluation  of  cockpit  factors  that  may  increase  glare  sensitivity  is  being  performed 
with  the  assistance  of  a  contract  with  a  university-based  group. 

For  further  information  on  these  research  topics,  please  contact  Van  B. 
Nakagawara,  O.D.,  FAA-CAMl,  P.O.  Box  25082,  AAM-620,  Oklahoma  City,  OK 
73125,  Phone:  405/680-4875. 

V.  Visual  Scanning  Behavior. 

An  air  traffic  controller  in  front  of  a  sector  suite  display  must  be  continuously 
aware  of  events  occurring  within  a  large  visual  space.  As  the  workload  increases 
(the  number  of  events,  rate  of  occurrence),  the  controller's  task  becomes  increasingly 
difficult.  There  is  a  general  tendency  in  these  conditions  to  concentrate,  or  "lock" 
onto,  some  subset  of  the  events,  largely  or  completely  ignoring  any  other  displayed 
information.  Our  research  is  investigating  some  of  the  display-oriented  factors  which 
may  influence  this  "locking"  tendency.  The  results  to  date  suggest  that  factors  such 
as  workload  differences  and  spacing  between  display  areas  are  not  very  important. 
We  are  currently  investigating  the  effects  of  assigning  different  values  to  displayed 
events.  We  anticipate  that  during  high  workloads,  the  subjects  will  tend  to  lock  onto 
the  higher  valued  event. 

One  limit  of  our  present  system  is  that  the  on-screen  events  are  stationary. 
That  is,  they  involve  reading  symbols  occurring  within  limited  and  predictable 
locations  on  the  display.  In  reality,  the  task  of  the  air  traffic  controller  is  mostly 
concerned  with  evaluating  complex  patterns  of  aircraft  movement  on  their  displays. 
We  are  planning  to  implement  tests  in  which  the  subject  evaluates  patterns  of 
movement  on  the  display.  For  example,  are  any  of  the  moving  symbols  on  screen 
about  to  collide?  If  so,  which  ones?  Where  will  the  collision  occur?  If  more  than 
2  symbols  will  collide,  which  will  collide  first?  As  in  our  previous  research,  the 
experimental  design  will  attempt  to  define  some  of  the  factors  controlling  attention 
locking. 

For  further  information  on  this  research,  please  contact  Alvin  M.  Revzin,  Ph.D., 
FAA-CAMl,  P.O.  Box  25082,  AAM-623,  Oklahoma  City,  OK  73125,  Phone: 
405/680-4875. 
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8  Human  Factors  Research  Laboratory 


- -  unwraiory 

Laborawry.  Hum^R^^^**^^  Human  Fa«ors  Research 
Yli-  «•»  Measures  as  _  oescnbed  below. 


VI  G*,o  ^  a|re  described  below 

Arc  AS^ST  «  -  ^veo  Responses  or  Missed  Signal  an 


w  —  •••  U I  | 

coS~  of  the  US/USSR 

for  ATC  Automation  Sto,,arov  from  the  °9y  and  involves 

Behavior  Research  Laborator^St*  "lute.'  J°hn  Stern  ,rom  WaSfng^"^®^ 


beTOrTO'lncSreasfn^y,S)J^^f^™®^b^'&f^S!S»,svtea^'^|rP*°V^*"^v°^>i^ 

procedures.  «evelop,ng  more  effective  error  pr^enS^tSqu^and' 

n _ . 


Kmton^eifS  b6  predi«~«  of 

dernonstara?edeaPskjn?ficant^^f0^T^  ^i°ffsaP^fetn^0arKfeByeum^H7^,^t^'^°^U^, 
during  simulator  fli|hts  ?K~ f  vvith  aspects  of  tk  "perfoSce^  *£ 

"T“L_  •  _ 


^fri6  measures 

Performance  are  related  ,o"1T  S  ^  *“£*£*  « 

_ § i  _  . . 


. 'vv«ui  CO  .  - 

~  rSSH^w®  &efryedcoa,LCAMi’  ^  » 

ofco'nhnwu^MmSf10"5  °n  ^"succetlive5^ 

altitude SSSSl!,1  PerformanJe  Viub^Saere'°nv'I!r0'ves  2  *>S 
same  flight  oath  ILT  T'  W  when  two  aircraft  a rT~?+tre  asked  to  detect  (a) 
Recording «?Si.!2?Jc,..th«  appearance  of£±5?J  '^nMme  altitude  on  the 


same  flight  oath  InX'fr't*'  (b)  when  two  aircraft d. asked  to  detect  (a 
Recordings  of  oaze  mfJC)  the  aPPearance  of  Taroets  ?h?t th®  83 ^  a|titude  on  the 
experiment  Visions  task  Performance^!  ™de  S?6"*  VFR  ^aft 

movements  (amplitude  anrf3?  rT^easures  include:  (i)  asDertctinUF°USly  dunn9  the 
duration;  (iii)  eve  blin!  ?td  duration);  (R)  information  £55?*.  of  saccadic  eye 
movements  not  Issociati^'"^  amP"tude,  an5T35S^<S2!m,nS  fixatic>n  pause 
and  performance  meesurls  STiT*'"9  of  8  ™to7 resp onse  The’1  „and  <lv>  head 

ures  will  be  compared  statistically  The  Qaze  measures 
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The  data  obtained  from  this  study  wili  contribute  to  a  better  understanding  of 
the  conditions  associated  with  loss  of  attention  or  vigilance  in  complex  monitoring. 

Vli.  Evaluation  of  Functional  Color  Vision  Requirements  and  Job-Related  Selection 

Tests  for  Aviation  Occupations. 

The  final  vision  project  to  be  described  is  being  conducted  in  the  Workload  and 
Performance  Section. 

Concerns  have  been  expressed  from  the  Equal  Employment  Opportunity  area 
that  FAA  color  vision  standards  may  be  too  strict  for  the  present  and  future  ATCS 
tasks,  and  that  color  vision  tests  are  not  validated  for  ATCS.  The  objectives  of  the 
present  project  are:  (1)  to  evaluate  and  validate  the  color  vision  standard  and  clinical 
color  vision  selection  tests  for  ATCSs  in  current  terminal,  center,  and  flight  service 
station  facilities,  (2)  to  develop  practical  color  vision  tests  for  use  in  selection  of 
ATCSs  for  the  current  work  environment,  and  (3)  to  evaluate  color  vision 
requirements  and  appropriate  selection  testing  for  the  next  generation  of  ATC 
workstations,  and  advanced  weather  information  systems  for  ATC  and  Flight  Service 
Station  (FSS). 

In  the  present  ATC  and  FSS  environments,  job  analysis  and  field  studies  of  job 
functions  identified  important  tasks  that  involve  color  as  a  primary,  non-redundant 
cue.  Those  tasks  are:  (1)  distinguishing  between  red  and  black  printing  and 
handwriting  on  flight  progress  strips  at  en  route  centers;  (2)  identifying  aircraft 
location  and  orientation  by  red,  green,  and  white  aircraft  position  lights  in  night 
tower  operations;  and  (3)  identifying  at  FSS  facilities  weather  radar  colors  that 
represent  different  precipitation  levels. 

An  experiment  was  conducted  to  evaluate  the  relation  of  type  and  degree  of 
color  vision  deficiency  and  aeromedical  clinical  color  vision  screening  test  scores  to 
performance  in  simulations  that  included  the  above  three  ATCS  color  tasks  involving 
non-redundant  color  coding.  The  subjects  included  1 21  normal  trichromats  and  1 23 
subjects  with  varying  type  and  degree  of  color  vision  deficiency  as  classified  with  the 
Nagel  anomaloscope.  Errors  were  rare  among  normal  trichromats.  Error  frequency 
in  the  simulated  ATC  tasks  increased  with  degree  of  color  vision  deficiency.  The 
aeromedical  clinical  color  vision  tests  had  acceptable  miss  rates,  but  a  few  tests  had 
high  false  alarm  rates.  Practical  color  vision  tests  have  been  developed  for  the  flight 
progress  strips  and  aviation  lights  tasks  that  are  related  to  en  route  center  and  tower 
situations,  respectively.  Those  tests  involve  reproductions  of  actual  flight  progress 
strips  and  actual  lights  that  meet  specifications  for  aviation-red,  -green,  and  -white. 
An  appropriate  simulation  method  for  a  practical  color  vision  test  pertaining  to  color 
weather  radar  is  currently  being  pursued. 

The  next  phase  of  this  project  will  involve  evaluation  of  color  vision 
requirements  and  appropriate  job-related  color  vision  test  methods  for  displays  of  the 
Advanced  Automation  System  Sector  Suite,  a  new  workstation  for  ATC,  and  for 
displays  of  NEXRAD  and  other  developing  systems. 

For  further  information  on  Human  Resources  Research  Division  vision  projects, 
please  contact  David  Schroeder,  Ph.D.,  FAA-CAMI,  P.0.  Box  25082,  AAM-500, 
Oklahoma  City,  OK  73125,  Phone:  405/680-4846. 
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Vision  Research  at  NASA  Ames  FLM  Branch 


John  A.  Perrone 


Human  Interface  Research  Branch 
Mail  Stop  262-2 


NASA  Ames  Research  Center 
Moffett  Field,  CA  94035-1000 


missions"  h\s  "the^n" '  commnmX/cZ0"!”^  °f  many  NASA 
man-machine  interactions.  The  S  L  ?  “  a  wide  range  of 
Research  Branch  at  NASA  Ames  is  invr.1  Pa°f  the  Huma"  Interface 
aspects  of  visual  information  processina  ‘a  “  reSearCh  into  man>' 
research  is  to  understand  how  the  ham.  A.comm°n  goal  of  this 
Visual  information  and  to  apply  that  In nST*'  SyStem  processes 
systems  which  will  be  mom  efficient  Td  gf  ‘°/he  desiS”  of 
operator.  With  respect  to  training  and  .  f°r  the  huma” 
research  can  be  divided  into  two  mam  areas  “me  Simulati<>“.  our 


J-  Di8ital  Image  Processing. 


or  visual  scene  attachment  Through  the  f  **  ViSUaI  dispIa3 

techniques,  digital  imagery  is  generated  r  °f  Computer  graphics 

scenes.  Many  algorithms  and  ideas  from  °th  S1™U5ate  out-the-window 
processing  are  incorporated  into  the  Z  ^  °f  digitaI  ^ge 
have  an  impact  on  the  the  realism  and  effefri  °f  dispIays  ^ 

e  Vision  Group  is  currently  involved  in  V6neSS  u°f  the  imaSery- 

P,CS  "  ‘he  ““  °f  *»«.  Processing  ZTZLSJLT*  * 

Z?ITLC™PCo2S  ArChiteCtUre  fw  ^iral  Imagery 

'Compmabona^V^iom^oio^PercepboP600051^0^00 
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-Exploiting  Perceptual  Transparency  in  Avionics  Displays 
-Visual  Display  Modeling  and  Evaluation 
-Image  Halftoning 
-Image  Fusion 


2.  Motion  Processing  in  Man  and  Machine. 

A  large  portion  of  the  research  of  the  Vision  Group  involves 
understanding  how  the  human  visual  system  processes  motion. 
Motion  is  important  in  any  activity  that  involves  movement  of 
oneself  or  a  craft  through  the  environment  and  hence  is  an  integral 
part  of  flight  control  and  simulation.  Understanding  how  humans  use 
visual  motion  information  in  these  tasks  helps  in  all  areas  where  the 
human  is  in  the  loop  and  has  an  impact  on  many  areas  of  human 
factors  engineering. 

Our  research  on  motion  can  itself  be  divided  into  two  areas:  The 
first  deals  with  trying  to  understand  how  the  visual  system 
processes  the  two-dimensional  motion  that  occurs  on  the  retina. 

Historically,  the  emphasis  of  the  group  has  been  on  the  development 
of  computational  models  of  motion  processing  but  there  is  also  a 
strong  psychophysical  experimental  program  underway  to  test  and 
refine  these  models.  One  of  the  first  pioneering  efforts  to  model 

human  2-D  motion  processing  through  the  use  of  spatio-temporal 
filters,  was  carried  out  by  members  of  the  Vision  Group  (Dr  A. 
Watson  and  Dr  A.  Ahumada).  Several  algorithms  have  also  been 
developed  within  the  group  for  the  estimation  of  two-dimensional 
image  velocity  fields  from  image  sequences. 

The  second  main  area  of  motion  research  deals  with  the  3- 

dimensional  motion  problem;  namely  how  does  the  visual  system 

use  the  2-D  motion  information  it  has  acquired  to  derive  information 
about  the  3-D  environment  such  as  heading  direction,  rotation  rates 
and  surface  layout?  We  have  developed  several  models  in  this  area 
and  have  an  ongoing  research  program  testing  human  performance 
in  3-D  self-motion  estimation.  This  research  has  important 
applications  in  the  areas  of  robotics,  obstacle  avoidance,  autonomous 
vehicles  and  nap-of-earth  rotorcraft  flight,  and  will  also  provide 
insights  into  the  motion  information  required  by  pilots  for  flight 
control. 
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Introduction 

Q  ^  I  j  —  I  . 

DerfS»I?5!'an^-Pfe|1i=tPMnybof  th.’H^^o^fhe^st^l.f, 


literature  !!y,b8  P°ssible  to  •transit ?gfu  can  be 
Performance.  Por^i?  ?any  of  the  effects  of  rnJS  Vast  vision 
known  optical  eXaciple#  if  NVD  behavior  NYD  on  visual 
directly  annUr^wi068'  then  studies  of  orvMCa?  Modeled  by 
fundmintaliy  1?,^®^®-  d“o»v& would  ^ 
Modelin,  mayV^Ll^-T' TgiSf-^iS  such 
The  . .  ........  idS*  “T  ™*  exist. 


The  fundamental  d.  ,  ri<59*'  “*  «UtT 

jwi&'intS  t“SdeJf!rS|°Jt“®  ^SSk^^^svic. '  s 

these  ratios  over  ffl  *nd  lts  output.  The  J?e  signal 

the  modulating  frequency  ranoe  jMf°^^ecbion  of 

conventional  optical*6*  faction  (HTF) .  is  caUed 

and  rate  of  Cal  systems  may  have  MTF  of 

SMI 

^und  with  convintimal^pUc^  “Mt 

”tput^ig^f**^“^PhyJicaffae««St°ffaft»r“i>'ing 
different gSajr  £!  PhLSlcal  ">eas“S£nt  ca£f,JBSut  «* 

«  •  two-dimensional 
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frequencies.  Another  method  presents  a  single  sharp  line  and 
measures  the  amount  of  spread  by  the  UVD,  which  is  then 
mathematically  transformed  with  Fourier  Analysis  into  a  MTF. 
It  is  important  to  note  that  the  human  visual  system  is  not 
involved  in  these  physical  determinations  and  therefore  any 
possible  interaction  with  the  visual  system  will  not  be 
round.  The  other  fundamental  approach  is  to  psychophys ica 1 1 v 
determine  MTF.  This  method  was  pioneered  by  Campbell  and 
Green  in  1965  for  the  human  eye.  The  minimum  amount  of 
contrast  required  for  subjects  t©  just  detect  a  two- 
dimensional  sinusoidal  grating  is  determined  with  and  without 
the  optical  device  processing  the  signal.  (The  reciprocal  of 
these  curves  are  contrast  sensitivity  functions.)  The  amount 
of  additional  contrast  required  to  detect  the  target  with  the 
device  is  equal  to  the  amount  that  the  signal  has  been 
demodulated  by  tee  device.  Thus,  the  ratio  between  the 
contrast  required  with  the  device  and  the  contrast  required 
without  tee  device  is  the  modulation  transfer  ratio.  The 
test  is  repeated  for  each  spatial  frequency  of  interest  and 
the  MTF  determined. 


Method 

The  NVDs  tested  were  two  pair  of  new  ANVIS  6s.  These  devices 
use  third  generation  imaging  tubes  auid  are  currently  in  use 
by  operational  forces.  The  subjects  were  two  male  aviation 
students  awaiting  flight  training;  they  were  physically 
qualified  for  flight  and  had  uacorrected  visual  acuity  of  at 
least  20/20  in  each  eye.  The  measurements  were  made  with  an 
Nicolet  Optronics  2000  contrast  sensitivity  tester.  This 
instrument  has  been  modified  with  a  kit  developed  by  the  u.S. 
Air  Force  (generously  provided  by  Col  Melvin  O'Neil)  to  allow 
two-interval  forced-choiee  testing  procedures.  The  luminance 
reaching  the  eye  was  adjusted  with  Kodak  neutral  density 
filters  (filter  factor  of  1.3)  so  that  it  was  perceptually 
equal  with  and  without  tee  NVD.  The  input  to  tee  goggles  was 
also  reduced  with  Kodak  neutral  density  filters  (filter 
factor  of  3.0}  to  allow  the  stimulus  to  be  viewed  through  the 
goggles  at  its  standard  luminance.  The  two  interval  forced 
choice  procedure  was  utilised  with  a  3  down/1  up  staircase. 

A  total  of  six  reversals  per  run  were  collected  with  the  last 
four  reversals  utilized  for  threshold  determination.  Each  of 
the  spatial  frequencies  (0,5,  1.25,  3.0,  4.5,  6.0,  12.0,  and 
18 . 0  cycles  per  degree)  were  tested  three  times  per  condition 
(unaided,  NVD  A,  and  NVD  B)  for  each  of  the  two  subjects. 

All  data  for  one  spatial  frequency  were  collected  before 
proceeding  to  the  next  spatial  frequency.  The  order  of  the 
spatial  frequencies,  subjects ,  and  conditions  were  all  ' 
counterbalanced . 

Results 

The  unaided  contrast  threshold  results  acre  presented  in 
Figure  l,  in  the  more  readily  recognized  contrast  sensitivity 
form.  The  contrast  sensitivity  (equal  to  1/threshold 
contrast)  is  plotted  on  the  logarithmic  y  axis,  as  a  function 
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bf™PS^aL5f?92*nfy  on  *  wu.  a.  error 

bars  are  equal  to  ±  one  standard  error.  These  result-*  *r* 

be?Se^®?t  "J1*  ^V^ature,  vith  setisi^tTp^nT 
hiahJr  cycles  per  degree  and  falling  offatbSth 

*«fhSL!!S5  J?wer  fPat?-®1  frequencies.  The  small  error  bars 
®®coth  flow  of  data  points  indicate  e  good  level  of 

border teff2ctI.reSUlting  in  consi8tent  results  and  a  lack 

In  Figure  2 ,  contrast  thresholds  obtained  with  the  two  ANVIS 
?8  ??T a  f ?Jed ’  Again  the  classic  inverted  'U*  function 

theefw^e«^«7ith  *S11  ?rror  1381,8  /  good  consistency  between 
the  two  goggles ,  and  a  lack  of  order  effects.  Note  that  at 
every  frequency  tested  (from  0.5  through  18  cycles  per 
performance  with  the  goggles  was  redSced. 

From  3.0  cycles  per  degree  and  higher  the  visual  performance 
was  reduced  by  approximately  one  order  of  magnitude.  Thus, 
visual  performance  is  not  only  limited  by  the  known  reduction 
in  best  visual  acuity  (a  factor  of  2  from  20/20  to  20/40.  or 
0 . 3  orders  of  magnitude) ,  but  is  dramatically  limited  by 
reduced  contrast  sensitivity  across  a  very  wide  range  of 
vision. 

The  MTFs  for  both  ANVIS  6  goggles  tested  are  shown  in  Figure 
3  .  The  ratio  between  the  threshold  contrast  with  the  NVD  and 
without  the  NVD  is  plotted  on  the  logarithmic  y  axis  as  a 
function  of  spatial  frequency  plotted  on  the  logarithmic  x 
axis.  The  error  bars  are  ±  one  standard  error  of  the  mean 
and  are  relatively  small.  The  results  of  the  two  tested 
goggles  are  essentially  the  same.  Again,  there  is  a  lack  of 
order  effects  demonstrated  by  the  smooth  flow  of  the 
interleaved  data  points.  The  shape  of  the  functions  is 
totaliy  unexpected.  The  shape  of  a  ’normal*  optical  systems 
MTF  is  expected  to  be  monotonic  anchoring  at  1  for  extremely 
low  (i»e.,  fat  bars)  spatial  frequencies  and  falling  smoothly 
to  a  cutoff  spatial  frequency.  Neither  pair  of  goggles 
demonstrated  this  shape.  The  performance  does  not  steadily 
decrease  to  the  cutoff  spatial  frequency  of  approximately  15 
degree.  Instead  a  plateau  of  performance  is 

fSJ-B££»lal*fI?^enci?8  of  3,0  cycles  per  degree  and 
Thf  ?TPs  goggles  are  clearly  inconsistent 

with  MTFs  of  ’normal*  optical  systems. 

Discussion 

'  S^^ftationB  of  visual  Performance  are 
^  the,bri9Jltn«ss  of  the  scene,  then  the  visual 

than  NVDs  wil1  158  significantly  worse 

d*  Interestingly,  these  expectations  of 
performance  may  not  be  conscious,  but  rather  may  function  at 

}?V®K  If  the  automatic  expectation  iS  to  See, 
unexpected  failure  to  see  can  have  catastrophic  results. 

i”?ividual  wh©  suffers  from  these  results 
problem  totally  unable  to  identify  the  source  of  the 
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"n“n““*°iMgeett°*^y  S*«uS?roJi0ptio2  d,alin9  *ith 
discretely  sampled^  oDtieJi*?* nic*  and  discontinuous 
“?f®  finding  wiuld  he™  £!***?!  *n  hindsight,  the 

.Uctroptice,  devices  leally 

Conclusions 

all  8patUirf?^JnCig  r^uc®d  visual  Performance  at 

experience  would  Sediet^?  t0,whst 

diviSe.  £un'a®“entally  different  th!j;£ire“S"?cili'V*ls' 

mission  accomplishment.  activity,  and  ultimately 
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ultimate  use  of  Njghf\^?1^^m^hl^^^^0"^ncerning  the  training  and 
lesson  learned  concerning  Night  Vision  ronment  One  important 

training  with  the  goggles  ^,ning  **  time 

goggle  time  while  traningteanhme  obte^tiZ  ^>ortaf^.Ther®fo,le.  obtaining  maximum 

Laboratory  has  developed  a  Dortahte  incvn^^A^Lr  rospace  Medical  Research 
w  in  »ay  replaces  C^gTce^iTn!^  ££  ft*  ^  J*«"n  Kit.  This 

description  of  micSSannel  ^ including  a  more  in-depth 

the  goggles  work  Descriotions  nt  ^  ®ain  a  ^3€^er  understancfing  of  how 

£‘3r“.‘,i£^sa“  ™™"' « A  wisss1 

as£5£-SSr-« 

strobe  lights  and  lasers  on  automat<c  ^S^tne^  control  and  the  effects  of 

demonsti^iof^pra^  exception  of  the  incompatible  lighting 

density  fitted  ^  ***  Wratten  "«*3 

slides  eliminates  anv  advert  affo^e  1,!  ,n  place  of  kodachrome  color 

chromatidty  transmission  The  kit  is  toS1|v^rtaKlfUtr^  5ensity  filters  may  ^ve  upon 

squadrons  having  easy  access  to  NVG’s t0  ^  co_,ocated  with 

necessary  projector  bHmo  (covert  wLlniSia®!**  2  "*“**  «P°^  along  with  the 

are  NVG‘s,  adark  rooma  CarajS^^ftnH  2?  °n  y  reduire™*nts  forthe  training 
room,  a  uarousei  projector  and  the  necessary  projector  blimp. 
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Williams  AFB,  AZ,  85240 


BACKGROUND 

Night  vision  devices  (NVD)  in  various  forms  have  been  used 
in  the  Air  Force  fixed  and  rotor  wing  aircraft  for  more  than 

and  denominator  spanning  all  weapon  systems 
and  mission  objectives  is  the  interface  between  a  helmet - 
mounted  visual  display  and  the  human  operator.  A  unified 
training  program  which  introduces  experienced  aircrew  members 
to  an  NVD  environment  win  form  a  solid  foundatf^  nacSsIry 
to  effectively  employ  such  visual  devices.  y 

During  the  past  year,  the  Aircrew  Training  ^Research  Division 
of  Armstrong  Laboratory  has  focused  on  developing  and 
evaluating  an  Initial  NVD  Training  program.  During  FY92  this 
program  will  transition  to  Kirtland  AFB,  NM,  for  operational 
evaluation  with  the  1550th  Combat  Crew  Training  Wing.  one 
aspect  of  this  training  program  of  interest  to  applied  vision 
researchers  are  the  NVD  Test  Lane. 


T7  .°.t,h.er  aspects  of  the  NVD  Training  Research  program  at 
williams  include  NVD  visual  task  performance  and  advanced  NVD 
simulation  techniques.  The  major  thrust  of  all  of  these 
efforts  is  to  investigate  cost-effective  ground-based  training 
techniques  which  adequately  prepare  air  crews  to  deal  with  the 
visual  limitations  imposed  by  unique  visual  systems. 


NVD  TEST  LANE 

The  term  MNVD  Test  Lane"  refers  to  a  set  of  standardized 
procedures,  an  NVD  Resolution  Chart  consisting  of  high 
resolution  square  wave  grating  patterns,  and  a  standardized 
light  source.  This  provides  crew  members  the  ability  to 
adjust  their  NVGs  to  obtain  the  best  visual  acuity  possible 

Xn  use  at  ^  Field  data  indicates  only 

about  30%  of  current  NVG  users  are  able  to  adjust  their 
goggles  to  achieve  the  best  visual  acuity  possible. 

The  basis  of  the  Test  Lane  is  a  measure  of  visual  acuity 
resolution  task  t0  det®rmine  the  minimum  distance 
between  objects  for  the  discrimination  of  separateness.  While 
visual  acuity  is  not  the  only  measurement  which  could  be  taken 
ntraft  festivity)  ,  it  is  an  expedient  method  to 
thZTi  controlled  setting  for  aircrew  members  to  perform 

deviL  itsllf  ^rt°hC  anJ  t0  assess  the  Unction  of  the 

device  itself.  With  a  known  target  (the  Resolution  Chart) 
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crewmember  has  ttiV'ab'ilitJ'to  ttlT*ifdthedd  proceduras.  the 

properly  and  performing  to  £&£  SZStSSUZ.' ******* 
MVG  TASK  PERFORMANCE 

The  ability  of  aircrew  members  to  nerfn^ 

(such  as  distance  estimation^  ««  P!f  some  Vlsual  tasks 
during  NVG  flight.  The  development  o^e/f^t  7  comPromised 
training  procedures  for  these  tasks  vi  1 1  ^®ctlve  ground-based 
to  rehearse  difficult  scenario  air<=rew  members 

currently  under  way  to  obtai^Derf^‘r»A^^ ^1flnary  Plans  are 
C^ition'  in~f light,  and  iifthe^ieid dataunder  simulated 
study,  the  database  used  for  T°.  suPPort  this 

evaluation  studies  is  beina  morfi ^i«^>^eV1°US  Vlsual  systems 
goggles,  once  complete  4??  dft?!^  with  ^ight  Jision 
studies  between  daytime  performann  allow  comparison 

performance  ^ith  Altrict^  h  f?1X  visuals'  daytime 

performance  with  NVG  aided  vision  This°Nvr  't'  ni9httime 
measure  can  then  be  used  in  an  evaluation  task  performance 
of  some  of  the  advance  wS 


ADVANCED  NVD  SIMULATION 

theledevelopment^ofS^:ost-effe^ia^rCr*W  trainin9  research  is 
provide  realTsti c  m issfon  ’  ground-based  systems  to 

SS  H3/-F  2#™ 

K-SS " •  “-.““Khv.3.  r  arw  SIS 
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Sigulatinq  NVGs.  The  second  approach  is  to  provide  a  visual 
i*age  which  simulates  the  response  of  the  W?G  a 
innovative  effort  underway  is  to  use  a  developmental  525-line 
helmet-mounted  CRT  display.  This  device  provides  an  infinity 
focused  40  degree  field  of  view.  By  integrating  the 
helmet-mounted  CRT  system  with  the  AVTS  imagery ,the  Lnio? 
imagery  of  NVGs  can  potentially  be  more  closely  duplicated. 


SUMMARY 

As  you  can  see,  the  Night  Vision  Device  Program  at  Williams 
focuses  on  the  development  ground-based  training  techniques 
and  facilities  to  enable  aircrew  member  to  obtain  optimum 
performance  with  their  visual  devices  under  compromising 
conditions.  y 
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